2024-08-17T02:14:22.137 INFO:root:teuthology version: 1.2.0 2024-08-17T02:14:22.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:14:22.254 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858271' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEstmrQH2KLuihP7M3W2+WzyQIuBtx4+7fH2baZYjcdARuzXCKERdkdT0Y4wd/uXlv0xGY26gJnIHL6J4hvS9MA= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMHkpxiZXzoQUndsNxcjNTKltr0TY7OsrcKJK+Ef/3PKv4QdYRbR3N9THm0/Fw/xUqhr+frtHCRObg6kK0emkg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:14:22.254 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:14:22.255 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:14:22.255 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:14:22.257 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:14:22.277 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:14:22.277 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:14:22.277 INFO:teuthology.packaging:ref: None 2024-08-17T02:14:22.278 INFO:teuthology.packaging:tag: None 2024-08-17T02:14:22.278 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:14:22.278 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:14:22.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:14:22.421 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:14:22.422 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:14:22.429 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:14:22.429 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:14:22.436 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:14:22.451 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:14:22.457 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:14:22.480 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:56.564907', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEstmrQH2KLuihP7M3W2+WzyQIuBtx4+7fH2baZYjcdARuzXCKERdkdT0Y4wd/uXlv0xGY26gJnIHL6J4hvS9MA='} 2024-08-17T02:14:22.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:56.563689', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMHkpxiZXzoQUndsNxcjNTKltr0TY7OsrcKJK+Ef/3PKv4QdYRbR3N9THm0/Fw/xUqhr+frtHCRObg6kK0emkg='} 2024-08-17T02:14:22.496 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:14:22.502 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:14:22.502 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:14:22.502 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:14:22.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdd6d073ac0>, signals=[15]) 2024-08-17T02:14:22.548 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:14:22.554 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:14:22.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:14:22.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:22.633 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:14:22.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:22.706 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:14:22.713 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-08-17T02:14:22.730 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-08-17T02:14:22.731 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-08-17T02:14:22.788 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:14:22.789 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:14:22.790 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-08-17T02:14:22.809 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-08-17T02:14:22.827 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-08-17T02:14:22.828 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-08-17T02:14:22.885 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-08-17T02:14:22.885 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:14:22.886 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:14:22.887 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-08-17T02:14:22.909 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:14:22.918 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:14:22.925 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:14:22.926 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:14:22.929 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:14:22.946 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:14:22.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:14:22.953 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:14:22.987 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:14:23.011 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:14:23.061 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:14:23.076 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:14:23.076 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:14:23.076 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:14:23.076 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:14:23.077 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:14:23.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:14:23.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:14:23.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:14:23.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:14:23.248 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:23.248 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:14:23.248 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-08-17T02:14:23.256 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:23.256 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:14:23.256 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-08-17T02:14:23.266 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:14:23.267 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:23.267 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:14:23.267 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum upgrade -y linux-firmware 2024-08-17T02:14:23.275 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:14:23.275 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:23.276 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:14:23.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum upgrade -y linux-firmware 2024-08-17T02:14:26.805 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-08-17T02:14:26.941 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-08-17T02:14:28.781 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-08-17T02:14:29.026 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:14:33.468 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-17T02:14:35.144 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 18 kB 00:00 2024-08-17T02:14:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-17T02:14:36.056 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-17T02:14:36.891 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-08-17T02:14:37.744 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-17T02:14:41.737 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-08-17T02:14:43.334 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-17T02:14:43.857 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-08-17T02:14:43.867 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 1 Package 2024-08-17T02:14:43.868 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:14:43.868 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 383 M 2024-08-17T02:14:43.868 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-08-17T02:14:45.456 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-08-17T02:14:45.469 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-08-17T02:14:45.469 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 1 Package 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 383 M 2024-08-17T02:14:45.470 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-08-17T02:14:49.897 INFO:teuthology.orchestra.run.smithi042.stdout:linux-firmware-20240716-145.el9.noarch.rpm 65 MB/s | 383 MB 00:05 2024-08-17T02:14:49.897 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:14:49.897 INFO:teuthology.orchestra.run.smithi042.stdout:Total 64 MB/s | 383 MB 00:06 2024-08-17T02:14:51.377 INFO:teuthology.orchestra.run.smithi062.stdout:linux-firmware-20240716-145.el9.noarch.rpm 66 MB/s | 383 MB 00:05 2024-08-17T02:14:51.377 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:14:51.377 INFO:teuthology.orchestra.run.smithi062.stdout:Total 65 MB/s | 383 MB 00:05 2024-08-17T02:14:53.132 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-08-17T02:14:53.212 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-08-17T02:14:53.212 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-08-17T02:14:54.618 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-08-17T02:14:54.704 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-08-17T02:14:54.704 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-08-17T02:14:56.632 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-08-17T02:14:56.633 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-08-17T02:14:58.102 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-08-17T02:14:58.102 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-08-17T02:15:06.159 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-08-17T02:15:06.898 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:06.988 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:07.272 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-08-17T02:15:07.892 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:07.892 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:08.087 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:08.177 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:08.635 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:08.635 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:15:08.635 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-08-17T02:15:08.635 INFO:teuthology.orchestra.run.smithi042.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:15:08.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:15:08.636 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-08-17T02:15:08.966 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:15:08.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:15:09.014 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:09.014 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:09.116 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:15:09.117 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:15:09.120 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi042.front.sepia.ceph.com to complete... 2024-08-17T02:15:09.801 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:09.801 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:15:09.801 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-08-17T02:15:09.801 INFO:teuthology.orchestra.run.smithi062.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:15:09.801 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:15:09.801 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-08-17T02:15:10.117 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:15:10.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:15:10.263 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:15:10.263 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:15:10.265 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi062.front.sepia.ceph.com to complete... 2024-08-17T02:15:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17 02:15:32 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:15:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:FINISHED --2024-08-17 02:15:32-- 2024-08-17T02:15:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:Total wall clock time: 24s 2024-08-17T02:15:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:Downloaded: 1 files, 344M in 23s (14.9 MB/s) 2024-08-17T02:15:32.781 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:15:32.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:15:34.955 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying... ######################################## 2024-08-17T02:15:35.014 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing... ######################################## 2024-08-17T02:15:35.068 INFO:teuthology.orchestra.run.smithi042.stdout:Updating / installing... 2024-08-17T02:15:43.483 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:15:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17 02:15:45 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:15:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:FINISHED --2024-08-17 02:15:45-- 2024-08-17T02:15:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:Total wall clock time: 35s 2024-08-17T02:15:45.639 INFO:teuthology.orchestra.run.smithi062.stderr:Downloaded: 1 files, 344M in 35s (9.89 MB/s) 2024-08-17T02:15:45.707 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:15:45.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:15:47.890 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying... ######################################## 2024-08-17T02:15:47.961 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing... ######################################## 2024-08-17T02:15:48.014 INFO:teuthology.orchestra.run.smithi062.stdout:Updating / installing... 2024-08-17T02:15:56.404 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:16:24.718 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:16:24.719 DEBUG:teuthology.orchestra.run.smithi042:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:24.814 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:16:24.815 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:16:24.816 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:16:24.817 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:16:24.818 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:16:24.819 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:16:24.820 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:16:24.821 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:16:24.822 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:16:24.823 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:16:24.824 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:16:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:16:24.826 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:16:24.827 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:16:24.828 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:16:24.829 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:16:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:16:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:16:24.832 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:16:24.833 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:16:24.834 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:16:24.835 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:16:24.836 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:16:24.837 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:16:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:16:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:16:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:16:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:16:24.841 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:16:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:16:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:16:24.844 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:16:24.845 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:16:24.846 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:16:24.847 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:16:24.848 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:16:24.849 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:16:24.850 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:16:24.851 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:16:24.852 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:16:24.853 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:16:24.854 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:16:24.855 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:16:24.856 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:16:24.857 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:16:24.858 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:16:24.859 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:16:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:16:24.861 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:16:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:16:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:16:24.864 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:16:24.864 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:16:24.864 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:16:24.864 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:16:24.864 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:16:24.865 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:16:24.866 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:16:24.867 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:16:24.868 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:16:24.869 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:16:24.870 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:16:24.871 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:16:24.872 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:16:24.873 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:16:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:16:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:16:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:16:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:16:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:16:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:16:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:16:24.876 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:16:24.877 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:16:24.878 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:16:24.879 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:16:24.880 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:16:24.881 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:16:24.882 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:16:24.884 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:16:24.885 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:16:24.886 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:16:24.887 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:16:24.888 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:16:24.889 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:16:24.890 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:16:24.891 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:16:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:16:24.893 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:16:24.894 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:16:24.895 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:16:24.896 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:16:24.897 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:16:24.898 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:16:24.899 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:16:24.900 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:16:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:16:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:16:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:16:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:16:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:16:24.901 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:16:24.902 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:16:24.903 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:16:24.904 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:16:24.905 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:16:24.906 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:16:24.906 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:16:24.907 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:16:24.908 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:16:24.908 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:16:24.909 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:16:24.910 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:16:24.911 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:16:24.912 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:16:24.913 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:16:24.914 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:16:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:16:24.916 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:16:24.917 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:16:24.918 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:16:24.919 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:16:24.920 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:16:24.921 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:16:24.922 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:16:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:16:24.924 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:16:24.925 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:16:24.926 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:16:24.926 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:16:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:16:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:16:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:16:24.930 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:16:24.930 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:16:24.930 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:16:24.930 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:16:24.931 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:16:24.932 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:16:24.933 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:16:24.934 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:16:24.935 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:16:24.936 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:16:24.937 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:16:24.938 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:16:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:16:24.940 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:16:24.940 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:16:24.940 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:16:24.941 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:16:24.942 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:16:24.943 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:16:24.944 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:16:24.945 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:16:24.946 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:16:24.947 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:16:24.948 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:16:24.949 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:16:24.950 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:16:24.951 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:16:24.952 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:16:24.953 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:16:24.954 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:16:24.955 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:16:24.956 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:16:24.957 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:16:24.958 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:16:24.958 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:16:24.958 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:16:24.958 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:16:24.958 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:16:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:16:24.960 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:16:24.961 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:16:24.962 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:16:24.963 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:16:24.964 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:16:24.964 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:16:24.965 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:16:24.966 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:16:24.967 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:16:24.968 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:16:24.969 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:16:24.970 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:16:24.971 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:16:24.972 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:16:24.973 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:16:24.974 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:16:24.975 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:16:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:16:24.977 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:16:24.978 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:16:24.979 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:16:24.981 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:16:24.982 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:16:24.983 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:16:24.984 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:16:24.985 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:16:24.986 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:16:24.987 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:16:24.988 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:16:24.989 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:16:24.990 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:16:24.990 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:16:24.990 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:16:24.990 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:16:24.990 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:16:24.991 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:16:24.992 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:24.997 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:24.997 DEBUG:teuthology.orchestra.run.smithi042:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:25.021 INFO:teuthology.orchestra.run.smithi042.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:16:25.021 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:25.021 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-17T02:16:25.021 INFO:teuthology.orchestra.run.smithi042.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:16:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: fi 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:done 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:16:25.022 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:25.023 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:25.023 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-08-17T02:16:25.024 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-08-17T02:16:25.098 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-08-17T02:16:25.098 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-08-17T02:16:25.098 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-08-17T02:16:25.098 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 68.el9 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8264254 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-08-17T02:16:25.099 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:16:25.100 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:16:25.101 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:16:25.101 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:25.101 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:16:25.786 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-08-17T02:16:27.207 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:16:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-08-17T02:16:27.266 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-08-17T02:16:27.322 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.xdMRIKvEQI 2024-08-17T02:16:27.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xdMRIKvEQI 2024-08-17T02:16:27.398 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.xdMRIKvEQI 2024-08-17T02:16:27.547 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.xdMRIKvEQI is 6KB 2024-08-17T02:16:27.569 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.xdMRIKvEQI 2024-08-17T02:16:27.584 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:16:27.646 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:16:27.646 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:16:27.646 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:16:27.646 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:16:27.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:27.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-08-17T02:16:35.461 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:16:35.461 DEBUG:teuthology.orchestra.run.smithi062:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.536 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:16:35.537 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:16:35.538 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:16:35.539 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:16:35.540 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:16:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:16:35.542 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:16:35.543 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:16:35.544 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:16:35.545 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:16:35.546 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:16:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:16:35.548 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:16:35.549 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:16:35.550 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:16:35.551 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:16:35.552 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:16:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:16:35.554 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:16:35.555 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:16:35.556 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:16:35.557 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:16:35.558 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:16:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:16:35.560 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:16:35.561 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:16:35.562 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:16:35.563 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:16:35.564 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:16:35.565 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:16:35.566 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:16:35.567 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:16:35.568 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:16:35.569 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:16:35.570 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:16:35.571 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:16:35.572 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:16:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:16:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:16:35.575 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:16:35.576 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:16:35.577 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:16:35.578 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:16:35.579 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:16:35.580 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:16:35.581 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:16:35.582 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:16:35.583 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:16:35.584 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:16:35.585 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:16:35.586 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:16:35.587 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:16:35.588 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:16:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:16:35.590 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:16:35.591 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:16:35.592 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:16:35.593 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:16:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:16:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:16:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:16:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:16:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:16:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:16:35.595 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:16:35.596 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:16:35.597 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:16:35.598 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:16:35.599 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:16:35.600 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:16:35.601 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:16:35.602 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:16:35.603 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:16:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:16:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:16:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:16:35.607 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:16:35.608 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:16:35.609 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:16:35.610 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:16:35.611 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:16:35.612 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:16:35.613 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:16:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:16:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:16:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:16:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:16:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:16:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:16:35.615 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:16:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:16:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:16:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:16:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:16:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:16:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:16:35.623 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:16:35.624 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:16:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:16:35.626 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:16:35.627 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:16:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:16:35.628 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:16:35.629 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:16:35.630 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:16:35.631 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:16:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:16:35.633 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:16:35.634 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:16:35.635 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:16:35.636 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:16:35.637 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:16:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:16:35.639 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:16:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:16:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:16:35.642 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:16:35.643 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:16:35.644 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:16:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:16:35.646 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:16:35.647 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:16:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:16:35.649 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:16:35.650 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:16:35.651 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:16:35.652 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:16:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:16:35.654 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:16:35.655 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:16:35.656 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:16:35.657 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:16:35.658 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:16:35.659 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:16:35.660 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:16:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:16:35.662 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:16:35.663 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:16:35.664 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:16:35.665 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:16:35.666 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:16:35.667 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:16:35.668 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:16:35.669 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:16:35.670 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:16:35.671 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:16:35.672 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:16:35.673 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:16:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:16:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:16:35.674 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:16:35.675 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:16:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:16:35.677 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:16:35.678 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:16:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:16:35.680 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:16:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:16:35.682 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:16:35.683 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:16:35.684 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:16:35.685 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:16:35.686 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:16:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:16:35.688 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:16:35.689 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:16:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:16:35.691 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:16:35.692 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:16:35.693 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:16:35.694 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:16:35.695 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:16:35.695 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:16:35.695 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:16:35.695 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:16:35.695 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:16:35.695 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:16:35.696 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:16:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:16:35.698 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:16:35.699 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:16:35.699 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:16:35.699 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:16:35.699 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:16:35.700 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:16:35.701 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:16:35.702 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:16:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:16:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:16:35.703 INFO:teuthology.orchestra.run.smithi062.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:35.707 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.707 DEBUG:teuthology.orchestra.run.smithi062:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:35.732 INFO:teuthology.orchestra.run.smithi062.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout: fi 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout:done 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:16:35.733 INFO:teuthology.orchestra.run.smithi062.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.734 INFO:teuthology.orchestra.run.smithi062.stdout:fi 2024-08-17T02:16:35.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-08-17T02:16:35.823 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-08-17T02:16:35.823 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:16:35.824 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-08-17T02:16:35.825 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:16:35.826 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:16:35.826 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:16:35.826 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:16:36.371 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-08-17T02:16:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:16:37.819 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-08-17T02:16:37.821 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-08-17T02:16:37.836 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.jwRH7sJQ22 2024-08-17T02:16:37.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jwRH7sJQ22 2024-08-17T02:16:37.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.jwRH7sJQ22 2024-08-17T02:16:38.044 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.jwRH7sJQ22 is 6KB 2024-08-17T02:16:38.093 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.jwRH7sJQ22 2024-08-17T02:16:38.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:16:38.170 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:16:38.171 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:16:38.171 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:16:38.171 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:16:38.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:38.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-08-17T02:16:57.810 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:16:57.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-17T02:16:57.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:08.362 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:17:08.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:17:08.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:16.259 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-08-17T02:17:25.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-17T02:17:25.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:26.754 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-08-17T02:17:35.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:17:35.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:38.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-08-17T02:17:50.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:17:50.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:53.918 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-08-17T02:18:08.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:18:08.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:12.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-08-17T02:18:25.283 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:18:30.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:18:30.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:30.528 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-08-17T02:18:31.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:18:31.065 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:18:31.065 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-08-17T02:18:31.103 INFO:teuthology.orchestra.run.smithi062.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:31.104 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:31.104 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:18:31.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:18:32.105 DEBUG:teuthology.parallel:result is None 2024-08-17T02:18:37.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-17T02:18:37.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:37.611 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-08-17T02:18:38.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-17T02:18:38.122 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:18:38.122 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-08-17T02:18:38.157 INFO:teuthology.orchestra.run.smithi042.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:38.157 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:38.157 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:18:38.157 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:18:39.160 DEBUG:teuthology.parallel:result is None 2024-08-17T02:18:39.161 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:18:39.168 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:18:39.168 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:18:39.173 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:18:39.213 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:18:39.221 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:18:39.227 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:18:39.228 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:18:39.252 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:18:39.314 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:18:39.321 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:18:39.322 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:18:39.327 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:18:39.425 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:39.464 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:39.467 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:39.523 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:18:39.527 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:18:39.533 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:18:39.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:18:39.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:18:39.595 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:18:39.604 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:18:39.605 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:18:39.609 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:18:39.643 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:39.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:39.818 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:39.882 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:39.951 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:18:39.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:18:40.007 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:40.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:18:40.150 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:40.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:18:40.285 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:18:40.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:18:40.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-08-17T02:18:40.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-08-17T02:18:40.417 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:18:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:18:40.947 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:18:40.955 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:18:40.955 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:18:40.965 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:18:40.975 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-08-17T02:18:41.064 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-08-17T02:18:41.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-08-17T02:18:41.181 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-08-17T02:18:41.184 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:18:41.184 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-08-17T02:18:41.225 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-08-17T02:18:41.225 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-08-17T02:18:41.266 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-08-17T02:18:41.266 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:18:41.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:18:41.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:18:41.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:18:41.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:18:41.382 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:18:41.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:18:41.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:18:41.503 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:18:41.513 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:18:41.530 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:18:41.531 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:24:27.075 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-08-17T02:24:27.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-17T02:24:27.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:24:27.171 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-08-17T02:24:27.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-08-17T02:24:27.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:24:27.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:24:27.374 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-08-17T02:24:27.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-08-17T02:24:27.483 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:24:27.493 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:24:27.493 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:24:27.494 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:24:27.497 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:24:27.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:24:27.554 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:24:27.585 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:24:27.585 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:24:27.615 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:24:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-08-17T02:24:27.660 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-08-17T02:24:27.667 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-08-17T02:24:27.689 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:24:27.691 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-08-17T02:24:27.718 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:24:27.720 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:24:27.750 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:24:27.813 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:24:27.819 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:24:27.819 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-08-17T02:24:27.820 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.820 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.820 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.820 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.851 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:24:27.858 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:24:27.858 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-08-17T02:24:27.858 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.858 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.858 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.858 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:27.859 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:24:27.867 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:24:27.867 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:24:27.867 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:24:27.867 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:24:27.873 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:24:27.873 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:24:27.874 DEBUG:teuthology.orchestra.run.smithi042:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:24:27.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:24:28.593 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:18 ago on Sat 17 Aug 2024 02:23:10 AM UTC. 2024-08-17T02:24:28.597 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:17 ago on Sat 17 Aug 2024 02:23:11 AM UTC. 2024-08-17T02:24:28.684 INFO:teuthology.orchestra.run.smithi042.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:24:28.687 INFO:teuthology.orchestra.run.smithi062.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:24:28.730 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-08-17T02:24:28.731 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-08-17T02:24:28.731 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-08-17T02:24:28.732 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-08-17T02:24:28.732 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-08-17T02:24:28.732 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-08-17T02:24:28.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:24:28.807 DEBUG:teuthology.orchestra.run.smithi042:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:of the main distribution, and quality may vary. 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:, 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:and packages are not held to any quality or security level. 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:24:29.060 INFO:teuthology.orchestra.run.smithi062.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:24:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:24:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:of the main distribution, and quality may vary. 2024-08-17T02:24:29.076 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-08-17T02:24:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:24:29.076 INFO:teuthology.orchestra.run.smithi042.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:24:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:, 2024-08-17T02:24:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:and packages are not held to any quality or security level. 2024-08-17T02:24:29.077 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-08-17T02:24:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:24:29.077 INFO:teuthology.orchestra.run.smithi042.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:24:29.142 INFO:teuthology.orchestra.run.smithi062.stdout:Repository successfully enabled. 2024-08-17T02:24:29.155 INFO:teuthology.orchestra.run.smithi042.stdout:Repository successfully enabled. 2024-08-17T02:24:29.187 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:24:29.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:29.200 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:24:29.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:29.335 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:24:29.335 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:24:29.340 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:24:29.340 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:24:29.476 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:24:29.476 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:24:29.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:24:29.478 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:24:29.479 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:24:29.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:24:29.534 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:24:29.534 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:24:29.536 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:24:29.536 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:24:29.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:24:29.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:24:29.710 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:24:29.712 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:24:29.765 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-08-17T02:24:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-08-17T02:24:29.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-08-17T02:24:29.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-08-17T02:24:30.048 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-08-17T02:24:30.058 INFO:teuthology.orchestra.run.smithi062.stdout:45 files removed 2024-08-17T02:24:30.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:24:30.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:24:30.841 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 203 kB/s | 77 kB 00:00 2024-08-17T02:24:30.844 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 205 kB/s | 77 kB 00:00 2024-08-17T02:24:31.317 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 25 kB/s | 11 kB 00:00 2024-08-17T02:24:31.344 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-08-17T02:24:31.701 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 5.2 kB/s | 1.8 kB 00:00 2024-08-17T02:24:31.720 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 5.3 kB/s | 1.8 kB 00:00 2024-08-17T02:24:31.927 INFO:teuthology.orchestra.run.smithi042.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:24:31.945 INFO:teuthology.orchestra.run.smithi062.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:24:32.402 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-08-17T02:24:32.595 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-17T02:24:34.680 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-17T02:24:35.720 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-08-17T02:24:40.954 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.6 MB 00:01 2024-08-17T02:24:41.222 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.6 MB 00:02 2024-08-17T02:24:42.738 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 18 kB 00:00 2024-08-17T02:24:43.097 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 18 kB 00:00 2024-08-17T02:24:43.793 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:24:44.435 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-08-17T02:24:50.341 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-08-17T02:24:51.016 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-08-17T02:24:52.954 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:52.955 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:24:52.969 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:24:52.971 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:24:52.973 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:24:52.974 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:24:53.042 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-08-17T02:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-08-17T02:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-08-17T02:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-08-17T02:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-08-17T02:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:24:53.060 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:24:53.061 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:24:53.062 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:24:53.063 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-08-17T02:24:53.064 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:24:53.065 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:24:53.066 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:24:53.067 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:24:53.068 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:24:53.069 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:24:53.070 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:24:53.071 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:24:53.072 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-08-17T02:24:53.072 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-08-17T02:24:53.072 INFO:teuthology.orchestra.run.smithi042.stdout:Install 121 Packages 2024-08-17T02:24:53.072 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 12 Packages 2024-08-17T02:24:53.072 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:24:53.073 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 206 M 2024-08-17T02:24:53.073 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-08-17T02:24:53.584 INFO:teuthology.orchestra.run.smithi042.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2024-08-17T02:24:53.629 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:53.630 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:24:53.641 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:24:53.641 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:24:53.643 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:24:53.643 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:24:53.645 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:24:53.647 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:24:53.648 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:24:53.714 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-08-17T02:24:53.733 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:24:53.740 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:24:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:24:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:24:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:24:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:24:53.741 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:24:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:24:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:24:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:24:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:24:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:24:53.742 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:24:53.743 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:24:53.744 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:24:53.745 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:24:53.746 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout:Install 121 Packages 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 12 Packages 2024-08-17T02:24:53.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:24:53.748 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 206 M 2024-08-17T02:24:53.748 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-08-17T02:24:53.867 INFO:teuthology.orchestra.run.smithi042.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 2.8 MB/s | 813 kB 00:00 2024-08-17T02:24:53.982 INFO:teuthology.orchestra.run.smithi042.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 8.2 MB/s | 5.0 MB 00:00 2024-08-17T02:24:54.009 INFO:teuthology.orchestra.run.smithi042.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 970 kB/s | 137 kB 00:00 2024-08-17T02:24:54.118 INFO:teuthology.orchestra.run.smithi042.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 2.1 MB 00:00 2024-08-17T02:24:54.259 INFO:teuthology.orchestra.run.smithi062.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 30 kB/s | 6.5 kB 00:00 2024-08-17T02:24:54.360 INFO:teuthology.orchestra.run.smithi042.stdout:(6/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 16 MB/s | 3.9 MB 00:00 2024-08-17T02:24:54.394 INFO:teuthology.orchestra.run.smithi042.stdout:(7/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 3.7 MB/s | 1.4 MB 00:00 2024-08-17T02:24:54.484 INFO:teuthology.orchestra.run.smithi062.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 3.5 MB/s | 813 kB 00:00 2024-08-17T02:24:54.584 INFO:teuthology.orchestra.run.smithi062.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.3 MB/s | 137 kB 00:00 2024-08-17T02:24:55.243 INFO:teuthology.orchestra.run.smithi062.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 2.1 MB 00:00 2024-08-17T02:24:55.635 INFO:teuthology.orchestra.run.smithi062.stdout:(5/133): ceph-common-17.2.7-1375.g2577e813.el9. 14 MB/s | 22 MB 00:01 2024-08-17T02:24:55.677 INFO:teuthology.orchestra.run.smithi062.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 3.3 MB/s | 1.4 MB 00:00 2024-08-17T02:24:55.706 INFO:teuthology.orchestra.run.smithi042.stdout:(8/133): ceph-osd-17.2.7-1375.g2577e813.el9.x86 11 MB/s | 15 MB 00:01 2024-08-17T02:24:55.786 INFO:teuthology.orchestra.run.smithi042.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 317 kB/s | 25 kB 00:00 2024-08-17T02:24:55.885 INFO:teuthology.orchestra.run.smithi062.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 16 MB/s | 3.9 MB 00:00 2024-08-17T02:24:56.236 INFO:teuthology.orchestra.run.smithi042.stdout:(10/133): ceph-common-17.2.7-1375.g2577e813.el9 7.9 MB/s | 22 MB 00:02 2024-08-17T02:24:56.345 INFO:teuthology.orchestra.run.smithi042.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.9 MB/s | 215 kB 00:00 2024-08-17T02:24:56.446 INFO:teuthology.orchestra.run.smithi042.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 250 kB/s | 25 kB 00:00 2024-08-17T02:24:56.752 INFO:teuthology.orchestra.run.smithi062.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 16 MB/s | 14 MB 00:00 2024-08-17T02:24:56.795 INFO:teuthology.orchestra.run.smithi042.stdout:(13/133): ceph-radosgw-17.2.7-1375.g2577e813.el 5.9 MB/s | 14 MB 00:02 2024-08-17T02:24:56.802 INFO:teuthology.orchestra.run.smithi062.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 506 kB/s | 25 kB 00:00 2024-08-17T02:24:56.863 INFO:teuthology.orchestra.run.smithi042.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 1.5 MB/s | 636 kB 00:00 2024-08-17T02:24:56.896 INFO:teuthology.orchestra.run.smithi042.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.6 MB/s | 163 kB 00:00 2024-08-17T02:24:56.938 INFO:teuthology.orchestra.run.smithi042.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.6 MB/s | 126 kB 00:00 2024-08-17T02:24:56.988 INFO:teuthology.orchestra.run.smithi042.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 4.9 MB/s | 458 kB 00:00 2024-08-17T02:24:57.070 INFO:teuthology.orchestra.run.smithi062.stdout:(10/133): ceph-base-17.2.7-1375.g2577e813.el9.x 1.6 MB/s | 5.0 MB 00:03 2024-08-17T02:24:57.081 INFO:teuthology.orchestra.run.smithi042.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 491 kB/s | 45 kB 00:00 2024-08-17T02:24:57.173 INFO:teuthology.orchestra.run.smithi042.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.3 MB/s | 120 kB 00:00 2024-08-17T02:24:57.211 INFO:teuthology.orchestra.run.smithi062.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.5 MB/s | 215 kB 00:00 2024-08-17T02:24:57.265 INFO:teuthology.orchestra.run.smithi042.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 1.9 MB/s | 182 kB 00:00 2024-08-17T02:24:57.303 INFO:teuthology.orchestra.run.smithi062.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 273 kB/s | 25 kB 00:00 2024-08-17T02:24:57.357 INFO:teuthology.orchestra.run.smithi042.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 3.9 MB/s | 369 kB 00:00 2024-08-17T02:24:57.482 INFO:teuthology.orchestra.run.smithi042.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 2.7 MB/s | 344 kB 00:00 2024-08-17T02:24:57.574 INFO:teuthology.orchestra.run.smithi042.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.2 MB/s | 116 kB 00:00 2024-08-17T02:24:57.666 INFO:teuthology.orchestra.run.smithi042.stdout:(24/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 895 kB/s | 82 kB 00:00 2024-08-17T02:24:57.720 INFO:teuthology.orchestra.run.smithi062.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 1.5 MB/s | 636 kB 00:00 2024-08-17T02:24:57.895 INFO:teuthology.orchestra.run.smithi062.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 932 kB/s | 163 kB 00:00 2024-08-17T02:24:57.908 INFO:teuthology.orchestra.run.smithi042.stdout:(25/133): librgw2-17.2.7-1375.g2577e813.el9.x86 5.1 MB/s | 4.9 MB 00:00 2024-08-17T02:24:58.029 INFO:teuthology.orchestra.run.smithi062.stdout:(15/133): librados-devel-17.2.7-1375.g2577e813. 948 kB/s | 126 kB 00:00 2024-08-17T02:24:58.033 INFO:teuthology.orchestra.run.smithi042.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 1.3 MB/s | 165 kB 00:00 2024-08-17T02:24:58.092 INFO:teuthology.orchestra.run.smithi042.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 6.9 MB/s | 2.9 MB 00:00 2024-08-17T02:24:58.117 INFO:teuthology.orchestra.run.smithi042.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 292 kB/s | 24 kB 00:00 2024-08-17T02:24:58.176 INFO:teuthology.orchestra.run.smithi042.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.5 MB/s | 124 kB 00:00 2024-08-17T02:24:58.271 INFO:teuthology.orchestra.run.smithi062.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 1.9 MB/s | 458 kB 00:00 2024-08-17T02:24:58.843 INFO:teuthology.orchestra.run.smithi042.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 4.6 MB/s | 3.4 MB 00:00 2024-08-17T02:24:58.910 INFO:teuthology.orchestra.run.smithi042.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 3.5 MB/s | 240 kB 00:00 2024-08-17T02:24:58.977 INFO:teuthology.orchestra.run.smithi042.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 716 kB/s | 47 kB 00:00 2024-08-17T02:24:59.077 INFO:teuthology.orchestra.run.smithi042.stdout:(33/133): ceph-mgr-diskprediction-local-17.2.7- 8.2 MB/s | 7.4 MB 00:00 2024-08-17T02:24:59.102 INFO:teuthology.orchestra.run.smithi042.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 117 kB/s | 15 kB 00:00 2024-08-17T02:24:59.161 INFO:teuthology.orchestra.run.smithi042.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.1 MB/s | 269 kB 00:00 2024-08-17T02:24:59.186 INFO:teuthology.orchestra.run.smithi042.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 988 kB/s | 83 kB 00:00 2024-08-17T02:24:59.211 INFO:teuthology.orchestra.run.smithi042.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 361 kB/s | 18 kB 00:00 2024-08-17T02:24:59.263 INFO:teuthology.orchestra.run.smithi062.stdout:(17/133): ceph-test-17.2.7-1375.g2577e813.el9.x 19 MB/s | 48 MB 00:02 2024-08-17T02:24:59.295 INFO:teuthology.orchestra.run.smithi042.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 734 kB/s | 80 kB 00:00 2024-08-17T02:24:59.387 INFO:teuthology.orchestra.run.smithi042.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-08-17T02:24:59.438 INFO:teuthology.orchestra.run.smithi062.stdout:(18/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 4.1 MB/s | 15 MB 00:03 2024-08-17T02:24:59.462 INFO:teuthology.orchestra.run.smithi042.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-08-17T02:24:59.463 INFO:teuthology.orchestra.run.smithi062.stdout:(19/133): python3-ceph-argparse-17.2.7-1375.g25 226 kB/s | 45 kB 00:00 2024-08-17T02:24:59.488 INFO:teuthology.orchestra.run.smithi042.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-08-17T02:24:59.488 INFO:teuthology.orchestra.run.smithi062.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 2.4 MB/s | 120 kB 00:00 2024-08-17T02:24:59.522 INFO:teuthology.orchestra.run.smithi062.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 3.1 MB/s | 182 kB 00:00 2024-08-17T02:24:59.530 INFO:teuthology.orchestra.run.smithi042.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-08-17T02:24:59.581 INFO:teuthology.orchestra.run.smithi062.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 3.9 MB/s | 369 kB 00:00 2024-08-17T02:24:59.606 INFO:teuthology.orchestra.run.smithi062.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 4.0 MB/s | 344 kB 00:00 2024-08-17T02:24:59.623 INFO:teuthology.orchestra.run.smithi062.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 2.7 MB/s | 116 kB 00:00 2024-08-17T02:24:59.656 INFO:teuthology.orchestra.run.smithi062.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:24:59.707 INFO:teuthology.orchestra.run.smithi062.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:24:59.782 INFO:teuthology.orchestra.run.smithi062.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 326 kB/s | 24 kB 00:00 2024-08-17T02:24:59.832 INFO:teuthology.orchestra.run.smithi062.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.4 MB/s | 124 kB 00:00 2024-08-17T02:24:59.999 INFO:teuthology.orchestra.run.smithi062.stdout:(29/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 20 MB/s | 3.4 MB 00:00 2024-08-17T02:25:00.058 INFO:teuthology.orchestra.run.smithi062.stdout:(30/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 6.8 MB/s | 2.9 MB 00:00 2024-08-17T02:25:00.066 INFO:teuthology.orchestra.run.smithi042.stdout:(43/133): ceph-test-17.2.7-1375.g2577e813.el9.x 11 MB/s | 48 MB 00:04 2024-08-17T02:25:00.081 INFO:teuthology.orchestra.run.smithi042.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 246 kB/s | 135 kB 00:00 2024-08-17T02:25:00.123 INFO:teuthology.orchestra.run.smithi042.stdout:(45/133): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-08-17T02:25:00.125 INFO:teuthology.orchestra.run.smithi062.stdout:(31/133): librgw2-17.2.7-1375.g2577e813.el9.x86 2.7 MB/s | 4.9 MB 00:01 2024-08-17T02:25:00.150 INFO:teuthology.orchestra.run.smithi062.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.6 MB/s | 240 kB 00:00 2024-08-17T02:25:00.175 INFO:teuthology.orchestra.run.smithi062.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 953 kB/s | 47 kB 00:00 2024-08-17T02:25:00.189 INFO:teuthology.orchestra.run.smithi042.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-17T02:25:00.200 INFO:teuthology.orchestra.run.smithi062.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 293 kB/s | 15 kB 00:00 2024-08-17T02:25:00.225 INFO:teuthology.orchestra.run.smithi062.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.3 MB/s | 269 kB 00:00 2024-08-17T02:25:00.251 INFO:teuthology.orchestra.run.smithi062.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:25:00.256 INFO:teuthology.orchestra.run.smithi042.stdout:(47/133): python3-requests-2.25.1-8.el9.noarch. 651 kB/s | 125 kB 00:00 2024-08-17T02:25:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 433 kB/s | 18 kB 00:00 2024-08-17T02:25:00.324 INFO:teuthology.orchestra.run.smithi042.stdout:(48/133): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-08-17T02:25:00.349 INFO:teuthology.orchestra.run.smithi042.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-08-17T02:25:00.374 INFO:teuthology.orchestra.run.smithi042.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-17T02:25:00.416 INFO:teuthology.orchestra.run.smithi042.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-08-17T02:25:00.452 INFO:teuthology.orchestra.run.smithi062.stdout:(38/133): ceph-mgr-diskprediction-local-17.2.7- 16 MB/s | 7.4 MB 00:00 2024-08-17T02:25:00.458 INFO:teuthology.orchestra.run.smithi042.stdout:(52/133): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-08-17T02:25:00.477 INFO:teuthology.orchestra.run.smithi062.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-08-17T02:25:00.483 INFO:teuthology.orchestra.run.smithi042.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-08-17T02:25:00.509 INFO:teuthology.orchestra.run.smithi042.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-08-17T02:25:00.526 INFO:teuthology.orchestra.run.smithi042.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-08-17T02:25:00.544 INFO:teuthology.orchestra.run.smithi062.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-08-17T02:25:00.559 INFO:teuthology.orchestra.run.smithi042.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-08-17T02:25:00.569 INFO:teuthology.orchestra.run.smithi062.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-08-17T02:25:00.601 INFO:teuthology.orchestra.run.smithi042.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-08-17T02:25:00.602 INFO:teuthology.orchestra.run.smithi062.stdout:(42/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-08-17T02:25:00.628 INFO:teuthology.orchestra.run.smithi062.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-17T02:25:00.653 INFO:teuthology.orchestra.run.smithi062.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-17T02:25:00.660 INFO:teuthology.orchestra.run.smithi042.stdout:(58/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-08-17T02:25:00.678 INFO:teuthology.orchestra.run.smithi062.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:25:00.685 INFO:teuthology.orchestra.run.smithi042.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-08-17T02:25:00.711 INFO:teuthology.orchestra.run.smithi042.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-08-17T02:25:00.720 INFO:teuthology.orchestra.run.smithi062.stdout:(46/133): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-08-17T02:25:00.744 INFO:teuthology.orchestra.run.smithi042.stdout:(61/133): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-08-17T02:25:00.745 INFO:teuthology.orchestra.run.smithi062.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-08-17T02:25:00.769 INFO:teuthology.orchestra.run.smithi042.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 35 kB 00:00 2024-08-17T02:25:00.814 INFO:teuthology.orchestra.run.smithi042.stdout:(63/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 292 kB 00:00 2024-08-17T02:25:00.862 INFO:teuthology.orchestra.run.smithi062.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 187 kB/s | 22 kB 00:00 2024-08-17T02:25:00.945 INFO:teuthology.orchestra.run.smithi042.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-08-17T02:25:01.012 INFO:teuthology.orchestra.run.smithi042.stdout:(65/133): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-08-17T02:25:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-08-17T02:25:01.037 INFO:teuthology.orchestra.run.smithi042.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-08-17T02:25:01.038 INFO:teuthology.orchestra.run.smithi062.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-08-17T02:25:01.071 INFO:teuthology.orchestra.run.smithi042.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-17T02:25:01.071 INFO:teuthology.orchestra.run.smithi062.stdout:(51/133): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-08-17T02:25:01.088 INFO:teuthology.orchestra.run.smithi062.stdout:(52/133): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-08-17T02:25:01.096 INFO:teuthology.orchestra.run.smithi042.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-08-17T02:25:01.121 INFO:teuthology.orchestra.run.smithi042.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-17T02:25:01.130 INFO:teuthology.orchestra.run.smithi062.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-08-17T02:25:01.147 INFO:teuthology.orchestra.run.smithi042.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:25:01.147 INFO:teuthology.orchestra.run.smithi062.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-08-17T02:25:01.164 INFO:teuthology.orchestra.run.smithi042.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 826 kB/s | 35 kB 00:00 2024-08-17T02:25:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-17T02:25:01.206 INFO:teuthology.orchestra.run.smithi042.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-08-17T02:25:01.206 INFO:teuthology.orchestra.run.smithi062.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 770 kB/s | 45 kB 00:00 2024-08-17T02:25:01.248 INFO:teuthology.orchestra.run.smithi062.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-17T02:25:01.282 INFO:teuthology.orchestra.run.smithi062.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-08-17T02:25:01.290 INFO:teuthology.orchestra.run.smithi042.stdout:(73/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:25:01.299 INFO:teuthology.orchestra.run.smithi062.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-08-17T02:25:01.315 INFO:teuthology.orchestra.run.smithi042.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-08-17T02:25:01.324 INFO:teuthology.orchestra.run.smithi062.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-17T02:25:01.340 INFO:teuthology.orchestra.run.smithi042.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:25:01.366 INFO:teuthology.orchestra.run.smithi062.stdout:(61/133): openblas-0.3.21-2.el9.x86_64.rpm 848 kB/s | 35 kB 00:00 2024-08-17T02:25:01.390 INFO:teuthology.orchestra.run.smithi042.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 563 kB/s | 42 kB 00:00 2024-08-17T02:25:01.416 INFO:teuthology.orchestra.run.smithi042.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-17T02:25:01.441 INFO:teuthology.orchestra.run.smithi042.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-17T02:25:01.467 INFO:teuthology.orchestra.run.smithi042.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:25:01.467 INFO:teuthology.orchestra.run.smithi062.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-08-17T02:25:01.491 INFO:teuthology.orchestra.run.smithi042.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:25:01.534 INFO:teuthology.orchestra.run.smithi042.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-08-17T02:25:01.600 INFO:teuthology.orchestra.run.smithi042.stdout:(82/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-08-17T02:25:01.626 INFO:teuthology.orchestra.run.smithi042.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-08-17T02:25:01.651 INFO:teuthology.orchestra.run.smithi042.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-17T02:25:01.676 INFO:teuthology.orchestra.run.smithi042.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:25:01.702 INFO:teuthology.orchestra.run.smithi042.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-08-17T02:25:01.802 INFO:teuthology.orchestra.run.smithi042.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-08-17T02:25:01.827 INFO:teuthology.orchestra.run.smithi042.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.0 MB/s | 309 kB 00:00 2024-08-17T02:25:01.853 INFO:teuthology.orchestra.run.smithi042.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:25:01.878 INFO:teuthology.orchestra.run.smithi042.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:25:01.903 INFO:teuthology.orchestra.run.smithi042.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:25:01.929 INFO:teuthology.orchestra.run.smithi042.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 567 kB/s | 14 kB 00:00 2024-08-17T02:25:01.987 INFO:teuthology.orchestra.run.smithi042.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-08-17T02:25:02.029 INFO:teuthology.orchestra.run.smithi042.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 2.7 MB/s | 548 kB 00:00 2024-08-17T02:25:02.063 INFO:teuthology.orchestra.run.smithi042.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:25:02.088 INFO:teuthology.orchestra.run.smithi042.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2024-08-17T02:25:02.114 INFO:teuthology.orchestra.run.smithi042.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 211 kB/s | 11 kB 00:00 2024-08-17T02:25:02.139 INFO:teuthology.orchestra.run.smithi042.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 350 kB/s | 18 kB 00:00 2024-08-17T02:25:02.150 INFO:teuthology.orchestra.run.smithi062.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-08-17T02:25:02.164 INFO:teuthology.orchestra.run.smithi042.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:25:02.190 INFO:teuthology.orchestra.run.smithi042.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-08-17T02:25:02.215 INFO:teuthology.orchestra.run.smithi042.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-17T02:25:02.240 INFO:teuthology.orchestra.run.smithi042.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:25:02.266 INFO:teuthology.orchestra.run.smithi042.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 814 kB/s | 41 kB 00:00 2024-08-17T02:25:02.291 INFO:teuthology.orchestra.run.smithi042.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:25:02.316 INFO:teuthology.orchestra.run.smithi042.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:25:02.342 INFO:teuthology.orchestra.run.smithi042.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:25:02.375 INFO:teuthology.orchestra.run.smithi042.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-08-17T02:25:02.400 INFO:teuthology.orchestra.run.smithi042.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-17T02:25:02.426 INFO:teuthology.orchestra.run.smithi042.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:02.475 INFO:teuthology.orchestra.run.smithi042.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 635 kB/s | 31 kB 00:00 2024-08-17T02:25:02.510 INFO:teuthology.orchestra.run.smithi042.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-08-17T02:25:02.535 INFO:teuthology.orchestra.run.smithi042.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:25:02.561 INFO:teuthology.orchestra.run.smithi042.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-08-17T02:25:02.586 INFO:teuthology.orchestra.run.smithi042.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-08-17T02:25:02.611 INFO:teuthology.orchestra.run.smithi042.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-17T02:25:02.636 INFO:teuthology.orchestra.run.smithi042.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:02.662 INFO:teuthology.orchestra.run.smithi042.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:25:02.687 INFO:teuthology.orchestra.run.smithi042.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-08-17T02:25:02.729 INFO:teuthology.orchestra.run.smithi042.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-08-17T02:25:02.796 INFO:teuthology.orchestra.run.smithi042.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-17T02:25:02.988 INFO:teuthology.orchestra.run.smithi042.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:25:03.089 INFO:teuthology.orchestra.run.smithi042.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 8.6 MB/s | 3.1 MB 00:00 2024-08-17T02:25:03.164 INFO:teuthology.orchestra.run.smithi042.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 8.0 MB/s | 2.9 MB 00:00 2024-08-17T02:25:03.231 INFO:teuthology.orchestra.run.smithi042.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 610 kB/s | 41 kB 00:00 2024-08-17T02:25:03.323 INFO:teuthology.orchestra.run.smithi042.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 2.6 MB/s | 247 kB 00:00 2024-08-17T02:25:03.373 INFO:teuthology.orchestra.run.smithi042.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 738 kB/s | 37 kB 00:00 2024-08-17T02:25:03.432 INFO:teuthology.orchestra.run.smithi042.stdout:(127/133): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-08-17T02:25:03.474 INFO:teuthology.orchestra.run.smithi042.stdout:(128/133): NetworkManager-1.48.2-2.el9.x86_64.r 4.8 MB/s | 2.3 MB 00:00 2024-08-17T02:25:03.524 INFO:teuthology.orchestra.run.smithi042.stdout:(129/133): NetworkManager-libnm-1.48.2-2.el9.x8 4.1 MB/s | 1.8 MB 00:00 2024-08-17T02:25:03.633 INFO:teuthology.orchestra.run.smithi062.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-08-17T02:25:03.649 INFO:teuthology.orchestra.run.smithi042.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 1.2 MB/s | 260 kB 00:00 2024-08-17T02:25:03.691 INFO:teuthology.orchestra.run.smithi042.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-08-17T02:25:03.767 INFO:teuthology.orchestra.run.smithi062.stdout:(65/133): openblas-openmp-0.3.21-2.el9.x86_64.r 2.0 MB/s | 4.7 MB 00:02 2024-08-17T02:25:03.792 INFO:teuthology.orchestra.run.smithi062.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2024-08-17T02:25:03.859 INFO:teuthology.orchestra.run.smithi062.stdout:(67/133): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-08-17T02:25:03.908 INFO:teuthology.orchestra.run.smithi042.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 6.2 MB/s | 2.4 MB 00:00 2024-08-17T02:25:03.950 INFO:teuthology.orchestra.run.smithi042.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 3.6 MB/s | 1.1 MB 00:00 2024-08-17T02:25:03.954 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:25:03.955 INFO:teuthology.orchestra.run.smithi042.stdout:Total 19 MB/s | 206 MB 00:10 2024-08-17T02:25:03.959 INFO:teuthology.orchestra.run.smithi062.stdout:(68/133): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-08-17T02:25:03.985 INFO:teuthology.orchestra.run.smithi062.stdout:(69/133): python3-jinja2-2.11.3-6.el9.noarch.rp 1.1 MB/s | 248 kB 00:00 2024-08-17T02:25:04.035 INFO:teuthology.orchestra.run.smithi062.stdout:(70/133): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-08-17T02:25:04.068 INFO:teuthology.orchestra.run.smithi062.stdout:(71/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-08-17T02:25:04.219 INFO:teuthology.orchestra.run.smithi062.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-08-17T02:25:04.361 INFO:teuthology.orchestra.run.smithi062.stdout:(73/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-08-17T02:25:04.444 INFO:teuthology.orchestra.run.smithi062.stdout:(74/133): python3-packaging-20.9-5.el9.noarch.r 928 kB/s | 77 kB 00:00 2024-08-17T02:25:04.503 INFO:teuthology.orchestra.run.smithi062.stdout:(75/133): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-08-17T02:25:04.586 INFO:teuthology.orchestra.run.smithi062.stdout:(76/133): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-08-17T02:25:04.653 INFO:teuthology.orchestra.run.smithi062.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-08-17T02:25:04.704 INFO:teuthology.orchestra.run.smithi062.stdout:(78/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:25:04.771 INFO:teuthology.orchestra.run.smithi062.stdout:(79/133): python3-requests-oauthlib-1.3.0-12.el 806 kB/s | 54 kB 00:00 2024-08-17T02:25:04.804 INFO:teuthology.orchestra.run.smithi062.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-08-17T02:25:04.847 INFO:teuthology.orchestra.run.smithi062.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-17T02:25:05.039 INFO:teuthology.orchestra.run.smithi062.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-08-17T02:25:05.130 INFO:teuthology.orchestra.run.smithi062.stdout:(83/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-08-17T02:25:05.205 INFO:teuthology.orchestra.run.smithi062.stdout:(84/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 854 kB/s | 64 kB 00:00 2024-08-17T02:25:05.272 INFO:teuthology.orchestra.run.smithi062.stdout:(85/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 673 kB/s | 45 kB 00:00 2024-08-17T02:25:05.348 INFO:teuthology.orchestra.run.smithi062.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 4.0 MB/s | 309 kB 00:00 2024-08-17T02:25:05.373 INFO:teuthology.orchestra.run.smithi062.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-17T02:25:05.398 INFO:teuthology.orchestra.run.smithi062.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-17T02:25:05.432 INFO:teuthology.orchestra.run.smithi062.stdout:(89/133): python3-asyncssh-2.13.2-5.el9.noarch. 16 MB/s | 548 kB 00:00 2024-08-17T02:25:05.457 INFO:teuthology.orchestra.run.smithi062.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:25:05.482 INFO:teuthology.orchestra.run.smithi062.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:25:05.507 INFO:teuthology.orchestra.run.smithi062.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 567 kB/s | 14 kB 00:00 2024-08-17T02:25:05.533 INFO:teuthology.orchestra.run.smithi062.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.8 MB/s | 172 kB 00:00 2024-08-17T02:25:05.566 INFO:teuthology.orchestra.run.smithi062.stdout:(94/133): python3-cherrypy-18.6.1-2.el9.noarch. 11 MB/s | 358 kB 00:00 2024-08-17T02:25:05.591 INFO:teuthology.orchestra.run.smithi062.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 8.7 MB/s | 220 kB 00:00 2024-08-17T02:25:05.617 INFO:teuthology.orchestra.run.smithi062.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 427 kB/s | 11 kB 00:00 2024-08-17T02:25:05.642 INFO:teuthology.orchestra.run.smithi062.stdout:(97/133): python3-jaraco-classes-3.2.1-5.el9.no 713 kB/s | 18 kB 00:00 2024-08-17T02:25:05.667 INFO:teuthology.orchestra.run.smithi062.stdout:(98/133): python3-jaraco-collections-3.0.0-8.el 933 kB/s | 23 kB 00:00 2024-08-17T02:25:05.681 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-08-17T02:25:05.693 INFO:teuthology.orchestra.run.smithi062.stdout:(99/133): python3-jaraco-functools-3.5.0-2.el9. 781 kB/s | 19 kB 00:00 2024-08-17T02:25:05.718 INFO:teuthology.orchestra.run.smithi062.stdout:(100/133): python3-jaraco-text-3.2.0-6.el9.noar 797 kB/s | 20 kB 00:00 2024-08-17T02:25:05.743 INFO:teuthology.orchestra.run.smithi062.stdout:(101/133): python3-jwt+crypto-2.4.0-1.el9.noarc 364 kB/s | 9.0 kB 00:00 2024-08-17T02:25:05.768 INFO:teuthology.orchestra.run.smithi062.stdout:(102/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.6 MB/s | 41 kB 00:00 2024-08-17T02:25:05.810 INFO:teuthology.orchestra.run.smithi062.stdout:(103/133): python3-kubernetes-26.1.0-2.el9.noar 25 MB/s | 1.0 MB 00:00 2024-08-17T02:25:05.835 INFO:teuthology.orchestra.run.smithi062.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:25:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:25:05.886 INFO:teuthology.orchestra.run.smithi062.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:25:05.907 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-08-17T02:25:05.908 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-08-17T02:25:05.920 INFO:teuthology.orchestra.run.smithi062.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-08-17T02:25:05.945 INFO:teuthology.orchestra.run.smithi062.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-08-17T02:25:05.970 INFO:teuthology.orchestra.run.smithi062.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:05.996 INFO:teuthology.orchestra.run.smithi062.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:25:06.030 INFO:teuthology.orchestra.run.smithi062.stdout:(111/133): python3-routes-2.5.1-5.el9.noarch.rp 5.5 MB/s | 188 kB 00:00 2024-08-17T02:25:06.054 INFO:teuthology.orchestra.run.smithi062.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2024-08-17T02:25:06.080 INFO:teuthology.orchestra.run.smithi062.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:25:06.105 INFO:teuthology.orchestra.run.smithi062.stdout:(114/133): python3-typing-extensions-4.12.2-2.e 3.0 MB/s | 74 kB 00:00 2024-08-17T02:25:06.139 INFO:teuthology.orchestra.run.smithi062.stdout:(115/133): python3-webob-1.8.7-6.el9.noarch.rpm 6.7 MB/s | 230 kB 00:00 2024-08-17T02:25:06.164 INFO:teuthology.orchestra.run.smithi062.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:06.198 INFO:teuthology.orchestra.run.smithi062.stdout:(117/133): python3-werkzeug-2.0.3-3.el9.1.noarc 13 MB/s | 427 kB 00:00 2024-08-17T02:25:06.223 INFO:teuthology.orchestra.run.smithi062.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-08-17T02:25:06.282 INFO:teuthology.orchestra.run.smithi062.stdout:(119/133): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-08-17T02:25:06.490 INFO:teuthology.orchestra.run.smithi062.stdout:(120/133): python3-numpy-1.20.1-5.el9.x86_64.rp 2.1 MB/s | 5.1 MB 00:02 2024-08-17T02:25:06.699 INFO:teuthology.orchestra.run.smithi062.stdout:(121/133): librados2-17.2.7-1375.g2577e813.el9. 7.4 MB/s | 3.1 MB 00:00 2024-08-17T02:25:06.882 INFO:teuthology.orchestra.run.smithi062.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-08-17T02:25:06.958 INFO:teuthology.orchestra.run.smithi062.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 24 MB/s | 1.8 MB 00:00 2024-08-17T02:25:06.999 INFO:teuthology.orchestra.run.smithi062.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 990 kB/s | 41 kB 00:00 2024-08-17T02:25:07.041 INFO:teuthology.orchestra.run.smithi062.stdout:(125/133): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-08-17T02:25:07.084 INFO:teuthology.orchestra.run.smithi062.stdout:(126/133): elfutils-debuginfod-client-0.191-4.e 881 kB/s | 37 kB 00:00 2024-08-17T02:25:07.125 INFO:teuthology.orchestra.run.smithi062.stdout:(127/133): elfutils-libelf-0.191-4.el9.x86_64.r 4.9 MB/s | 207 kB 00:00 2024-08-17T02:25:07.167 INFO:teuthology.orchestra.run.smithi062.stdout:(128/133): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-08-17T02:25:07.218 INFO:teuthology.orchestra.run.smithi062.stdout:(129/133): librbd1-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 2.9 MB 00:00 2024-08-17T02:25:07.260 INFO:teuthology.orchestra.run.smithi062.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-08-17T02:25:07.318 INFO:teuthology.orchestra.run.smithi062.stdout:(131/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 19 MB/s | 1.1 MB 00:00 2024-08-17T02:25:07.445 INFO:teuthology.orchestra.run.smithi062.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-08-17T02:25:08.115 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-08-17T02:25:08.116 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-08-17T02:25:13.244 INFO:teuthology.orchestra.run.smithi062.stdout:(133/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.9 MB/s | 16 MB 00:08 2024-08-17T02:25:13.248 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:25:13.248 INFO:teuthology.orchestra.run.smithi062.stdout:Total 11 MB/s | 206 MB 00:19 2024-08-17T02:25:14.167 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-08-17T02:25:14.256 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:25:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:25:14.382 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:25:14.425 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:25:14.457 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:25:14.514 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:25:14.867 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:25:14.974 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:14.978 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-08-17T02:25:15.104 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:15.133 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:15.205 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-08-17T02:25:15.205 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-08-17T02:25:15.257 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:15.759 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:15.801 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:15.905 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:16.003 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:25:16.028 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:16.152 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:16.179 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:16.335 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:16.600 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:25:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:17.030 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:17.124 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:17.392 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-08-17T02:25:17.393 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-08-17T02:25:17.474 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:17.544 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:25:17.592 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:25:17.685 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:25:17.766 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:25:17.864 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:25:17.929 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:25:17.961 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:25:18.009 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:25:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:25:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:25:18.178 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:25:18.267 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:25:18.458 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:25:18.526 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:25:19.226 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:25:19.328 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:25:19.381 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:25:19.436 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:25:19.480 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:25:19.527 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:25:19.581 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:25:19.619 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:25:19.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:25:20.053 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:25:20.095 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:25:20.132 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:25:20.191 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:25:20.243 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:25:20.318 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:25:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:25:20.559 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:25:20.603 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:25:20.735 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:25:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:25:20.859 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:25:20.891 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:25:20.928 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:25:20.966 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:25:21.003 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:25:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:25:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:25:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:25:21.156 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:25:21.191 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:25:21.243 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:25:21.372 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:25:21.440 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:25:22.403 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:25:22.482 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:25:22.515 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:25:22.640 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:22.691 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:25:22.929 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:25:22.963 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:25:23.071 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:25:23.465 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-08-17T02:25:23.557 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:25:23.608 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:25:23.674 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:25:23.717 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:25:23.749 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:25:23.805 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:25:23.936 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:25:24.083 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:25:24.156 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:25:24.288 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:24.421 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:24.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:24.702 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:25.226 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:25.260 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:25.356 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:25.456 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:25:25.487 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:25.610 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:25.638 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:25.794 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:25.800 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:25:25.901 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:25:25.938 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:25:25.971 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:25:26.063 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:25:26.244 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:25:26.321 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:26.348 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:26.438 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:26.500 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:26.525 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:25:26.538 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:26.893 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:26.935 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:25:26.981 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:25:27.066 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:25:27.246 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:25:27.280 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:25:27.381 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:25:27.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:25:27.483 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:25:27.531 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:25:27.621 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:25:27.670 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:25:27.717 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:25:27.813 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:25:27.998 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:25:28.098 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:25:28.789 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:25:28.900 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:25:28.952 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:25:29.088 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:25:29.170 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:25:29.209 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:29.262 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:25:29.288 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:29.301 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:25:29.363 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:25:29.450 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:25:29.485 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:25:29.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:25:29.582 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:25:29.633 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:25:29.692 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:25:29.873 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:25:29.908 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:29.916 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:25:29.959 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:25:29.985 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:25:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:25:30.089 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:25:30.090 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:25:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:30.116 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:25:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:30.158 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:25:30.201 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:25:30.232 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:25:30.269 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:25:30.307 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:25:30.344 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:25:30.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:25:30.412 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:25:30.456 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:25:30.488 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:25:30.523 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:25:30.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:25:30.701 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:25:30.763 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:25:31.728 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:25:31.780 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:25:31.814 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:25:31.937 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:31.989 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:25:32.227 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:25:32.262 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:25:32.360 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:25:33.234 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:25:33.382 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:25:35.071 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:25:35.200 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:25:35.237 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:25:35.269 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:25:35.602 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:25:35.648 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:35.765 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:35.791 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:25:38.499 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:38.538 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:39.166 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:39.208 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:25:39.345 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:25:39.346 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:25:39.346 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:25:39.346 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:39.375 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:42.637 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-08-17T02:25:42.638 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:42.869 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:42.907 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:42.907 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:42.907 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:25:42.907 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:44.436 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:44.495 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:44.496 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:44.728 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:44.780 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:44.781 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:44.781 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:25:44.781 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:44.781 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:44.781 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:45.212 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:45.264 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:45.397 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:25:45.458 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:25:45.540 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:25:45.850 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:25:45.940 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:25:46.059 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:25:46.239 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:25:46.297 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:25:46.321 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:25:46.358 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:25:46.407 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:25:46.439 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:25:46.928 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:46.956 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:46.986 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:25:47.059 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:25:47.086 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:48.316 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:48.363 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:49.516 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:49.691 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:25:49.924 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:49.977 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:49.977 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:49.977 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:25:49.977 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:49.977 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:49.977 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:50.024 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:50.051 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:50.197 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:25:50.260 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:25:51.611 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:51.611 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-08-17T02:25:51.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:51.657 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:25:51.694 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:25:51.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:25:51.833 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:51.833 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:25:51.833 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:51.833 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:25:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:51.856 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:25:51.856 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:51.856 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:25:51.856 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:25:51.929 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:25:51.929 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:51.929 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:25:51.929 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:51.996 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:25:52.047 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:25:52.047 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:52.047 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:25:52.047 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:52.048 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:25:52.048 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:25:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:25:52.439 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:52.439 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:25:52.440 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:25:52.440 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:25:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:25:53.383 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:53.441 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:25:53.441 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:53.441 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:25:53.442 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:53.442 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:25:53.442 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:53.675 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:53.725 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:54.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:54.201 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:25:54.201 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:54.201 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:25:54.201 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:54.201 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:25:54.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:54.343 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:25:54.404 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:25:54.478 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:25:54.714 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:25:54.767 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:25:54.857 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:25:54.971 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:25:55.151 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:25:55.209 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:25:55.233 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:25:55.270 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:25:55.318 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:25:55.343 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:25:55.806 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:55.843 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:25:55.873 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:25:55.936 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:25:55.965 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:57.185 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:25:57.259 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:57.451 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:25:57.535 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:25:57.580 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:25:57.616 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:25:57.650 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:25:57.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:25:57.724 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:25:57.784 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:25:57.828 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:25:58.415 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:25:58.451 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:58.595 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:25:58.770 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:25:58.803 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:58.855 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:25:58.855 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:25:58.855 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:25:58.855 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:58.855 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:25:58.855 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:25:58.912 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:58.938 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:25:59.042 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:25:59.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:25:59.228 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:25:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:25:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:25:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:25:59.712 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:25:59.752 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:25:59.785 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:25:59.819 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:25:59.848 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:25:59.848 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:25:59.964 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:25:59.996 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:25:59.996 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:26:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:00.408 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:00.408 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:00.517 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:26:00.545 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:00.575 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:00.603 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:26:00.644 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:00.644 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:00.644 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:26:00.644 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:00.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:00.678 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:00.691 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:00.741 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:26:00.742 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:00.800 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:00.850 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:26:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:00.851 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:00.851 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:00.888 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:00.888 INFO:teuthology.orchestra.run.smithi042.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:26:00.888 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:01.184 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:01.237 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:01.238 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:06.133 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:26:06.133 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:26:06.134 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:26:06.135 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:26:06.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:26:06.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:26:06.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:26:06.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:26:06.136 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:26:06.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:26:06.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:26:06.146 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:26:06.147 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:26:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:26:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:26:06.150 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:26:06.151 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:26:06.152 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:26:06.153 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:26:06.154 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:06.155 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:26:06.222 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:26:06.264 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:26:06.308 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:26:06.345 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:26:06.378 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:26:06.413 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:26:06.452 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:26:06.484 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:06.524 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:26:07.890 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:26:08.053 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.054 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.055 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.056 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:26:08.057 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.058 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:26:08.059 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:08.060 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.061 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:26:08.062 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:26:08.063 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:26:08.064 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:08.064 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-08-17T02:26:08.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:26:08.218 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:26:08.267 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:26:08.383 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:26:08.422 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:26:08.455 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:26:08.481 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:08.509 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:26:08.509 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:08.609 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:08.630 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:08.641 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:26:08.642 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:08.751 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:08.776 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:26:08.797 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:08.797 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:09.045 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:09.045 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:09.155 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:09.222 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:09.257 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:26:09.331 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:09.550 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:09.550 INFO:teuthology.orchestra.run.smithi062.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:26:09.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:26:14.667 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:26:14.668 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:26:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:26:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:26:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:26:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:26:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:26:14.669 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:26:14.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:14.689 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:16.575 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:16.576 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:16.576 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:16.576 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:26:16.576 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:26:16.577 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:26:16.577 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.577 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.577 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:16.577 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:16.577 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.578 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.579 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.579 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.579 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.579 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.580 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:26:16.581 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:26:16.582 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:26:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:26:16.584 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:26:16.585 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.586 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.587 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:16.588 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-08-17T02:26:17.169 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:17.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:17.317 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:26:17.367 INFO:teuthology.orchestra.run.smithi042.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:26:17.368 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:26:17.368 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:26:17.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:17.509 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:26:17.553 INFO:teuthology.orchestra.run.smithi062.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:26:17.554 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:26:17.554 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:26:17.556 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:26:17.556 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:17.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:17.621 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:17.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:17.681 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:26:17.681 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:17.681 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:17.741 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:17.839 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:17.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:17.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:17.994 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:26:17.995 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:17.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:18.056 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:18.153 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:18.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:18.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:18.308 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:26:18.308 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:18.308 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:18.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:18.462 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:18.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:18.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:18.616 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:26:18.693 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:26:18.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:18.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:18.759 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:26:18.759 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:18.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:18.826 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:26:18.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:18.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:18.894 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:26:18.894 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:26:18.894 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:26:18.894 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:18.894 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:18.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:19.098 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:19.155 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:19.155 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:19.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:19.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:19.432 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:26:19.432 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:26:19.432 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858271', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEstmrQH2KLuihP7M3W2+WzyQIuBtx4+7fH2baZYjcdARuzXCKERdkdT0Y4wd/uXlv0xGY26gJnIHL6J4hvS9MA=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMHkpxiZXzoQUndsNxcjNTKltr0TY7OsrcKJK+Ef/3PKv4QdYRbR3N9THm0/Fw/xUqhr+frtHCRObg6kK0emkg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:26:19.433 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:19.437 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:19.472 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:19.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:19.571 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:19.572 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:19.607 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:19.607 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:19.682 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:19.682 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:19.682 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-08-17T02:26:19.682 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:19.682 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:19.683 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-17 02:26:01.230353911 +0000 2024-08-17T02:26:19.683 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-17 02:23:39.256641184 +0000 2024-08-17T02:26:19.683 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-17 02:23:39.256641184 +0000 2024-08-17T02:26:19.683 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-17 02:23:39.256641184 +0000 2024-08-17T02:26:19.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:19.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-17T02:26:19.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-17T02:26:19.775 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.0001627 s, 3.1 MB/s 2024-08-17T02:26:19.778 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:19.814 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:19.890 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:19.890 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:19.890 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-08-17T02:26:19.890 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:19.890 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:19.891 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-17 02:26:01.230353911 +0000 2024-08-17T02:26:19.891 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-17 02:23:39.734637151 +0000 2024-08-17T02:26:19.891 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-17 02:23:39.734637151 +0000 2024-08-17T02:26:19.891 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-17 02:23:39.734637151 +0000 2024-08-17T02:26:19.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-17T02:26:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-17T02:26:19.982 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000174814 s, 2.9 MB/s 2024-08-17T02:26:19.985 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:20.022 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:20.097 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:20.097 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-17 02:26:01.231353902 +0000 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-17 02:23:40.213633147 +0000 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-17 02:23:40.213633147 +0000 2024-08-17T02:26:20.098 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-17 02:23:40.213633147 +0000 2024-08-17T02:26:20.098 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:20.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-17T02:26:20.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-17T02:26:20.191 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000172266 s, 3.0 MB/s 2024-08-17T02:26:20.193 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:20.230 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:20.305 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-08-17 02:26:01.232353894 +0000 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-08-17 02:23:40.667629357 +0000 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-08-17 02:23:40.667629357 +0000 2024-08-17T02:26:20.306 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-08-17 02:23:40.667629357 +0000 2024-08-17T02:26:20.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-08-17T02:26:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-08-17T02:26:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000172307 s, 3.0 MB/s 2024-08-17T02:26:20.401 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:20.437 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:20.437 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:20.438 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:20.477 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:20.478 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-08-17 02:26:09.890906052 +0000 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-08-17 02:23:41.728869449 +0000 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-08-17 02:23:41.728869449 +0000 2024-08-17T02:26:20.556 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-08-17 02:23:41.728869449 +0000 2024-08-17T02:26:20.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:20.652 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-08-17T02:26:20.653 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-08-17T02:26:20.653 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000421266 s, 1.2 MB/s 2024-08-17T02:26:20.655 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:20.694 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-08-17 02:26:09.891906037 +0000 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-08-17 02:23:42.237861780 +0000 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-08-17 02:23:42.237861780 +0000 2024-08-17T02:26:20.770 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-08-17 02:23:42.237861780 +0000 2024-08-17T02:26:20.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:20.863 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-08-17T02:26:20.863 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-08-17T02:26:20.863 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000280399 s, 1.8 MB/s 2024-08-17T02:26:20.866 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:20.902 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:20.977 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:20.977 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:20.977 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-08-17T02:26:20.978 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:20.978 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:20.978 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-08-17 02:26:09.892906022 +0000 2024-08-17T02:26:20.978 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-08-17 02:23:42.695854880 +0000 2024-08-17T02:26:20.978 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-08-17 02:23:42.695854880 +0000 2024-08-17T02:26:20.978 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-08-17 02:23:42.695854880 +0000 2024-08-17T02:26:20.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-08-17T02:26:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-08-17T02:26:21.071 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000280916 s, 1.8 MB/s 2024-08-17T02:26:21.074 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:21.110 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:21.185 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-08-17T02:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-08-17 02:26:09.893906006 +0000 2024-08-17T02:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-08-17 02:23:43.159847889 +0000 2024-08-17T02:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-08-17 02:23:43.159847889 +0000 2024-08-17T02:26:21.186 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-08-17 02:23:43.159847889 +0000 2024-08-17T02:26:21.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-08-17T02:26:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-08-17T02:26:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00029733 s, 1.7 MB/s 2024-08-17T02:26:21.281 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:21.317 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:21.317 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:21.317 INFO:tasks.ceph:Generating config... 2024-08-17T02:26:21.319 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:26:21.319 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:26:21.319 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:26:21.319 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:26:21.319 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:26:21.319 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:26:21.319 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:26:21.319 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:26:21.319 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:26:21.319 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:26:21.320 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:26:21.321 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:26:21.321 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:26:21.322 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:26:21.322 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:26:21.322 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:26:21.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:21.410 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:26:21.415 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:26:21.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:21.550 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.b', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]')] 2024-08-17T02:26:21.551 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:26:21.552 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:21.552 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:21.586 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --add b 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0 2024-08-17T02:26:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = octopus 2024-08-17T02:26:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-08-17T02:26:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:fsid f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0 2024-08-17T02:26:21.698 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-08-17T02:26:21.698575+0000 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-08-17T02:26:21.698575+0000 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 15 (octopus) 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-08-17T02:26:21.699 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:26:21.700 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:21.735 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0... 2024-08-17T02:26:21.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:21.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:21.873 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-08-17T02:26:21.873 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-08-17T02:26:21.873 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:21.873 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-08-17T02:26:21.873 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.873 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:21.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-08-17T02:26:21.875 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-08-17T02:26:21.876 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-08-17T02:26:21.877 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.878 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:21.879 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:21.879 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.881 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-08-17T02:26:21.882 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:21.883 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: debug finisher = 20 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:21.884 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.885 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds balancer = 20 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2024-08-17T02:26:21.887 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-08-17T02:26:21.888 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-08-17T02:26:21.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:21.890 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-08-17T02:26:21.891 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.42,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.892 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.893 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-08-17T02:26:21.894 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-08-17T02:26:21.895 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug finisher = 20 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-08-17T02:26:21.896 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.897 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-08-17T02:26:21.898 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = "" 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-08-17T02:26:21.899 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-08-17T02:26:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-08-17T02:26:21.904 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:26:21.904 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:26:21.994 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:26:21.995 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:21.995 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:26:22.030 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:22.030 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:26:22.104 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:26:22.105 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:22.105 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:22.105 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:22.223 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:22.223 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:22.298 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:26:22.298 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:22.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:22.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:22.378 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:22.378 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:22.453 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:26:22.454 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:26:22.454 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:22.552 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:22.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:22.662 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:22.668 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:26:22.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:22.767 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:22.772 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:26:22.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:22.927 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:22.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:26:22.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:23.086 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:23.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:26:23.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:23.244 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:23.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:26:23.305 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:26:23.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:23.381 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:23.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:23.483 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:23.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:23.584 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:23.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:23.686 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:23.713 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:26:23.713 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:23.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:23.770 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:23.770 INFO:tasks.ceph:role: osd.0 2024-08-17T02:26:23.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:26:23.770 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:23.825 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:23.859 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-08-17T02:26:23.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-08-17T02:26:23.862 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:23.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:24.007 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:24.062 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:24.062 INFO:tasks.ceph:role: osd.1 2024-08-17T02:26:24.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:26:24.062 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:26:24.117 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:24.117 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:24.117 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:24.118 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:24.150 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-08-17T02:26:24.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-08-17T02:26:24.155 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:24.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:24.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:24.355 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:24.355 INFO:tasks.ceph:role: osd.2 2024-08-17T02:26:24.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:26:24.355 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:26:24.410 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:24.411 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:24.444 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-08-17T02:26:24.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-08-17T02:26:24.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:24.527 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:24.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:24.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:24.645 INFO:tasks.ceph:role: osd.3 2024-08-17T02:26:24.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:26:24.646 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:26:24.700 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:24.701 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:24.734 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-08-17T02:26:24.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-08-17T02:26:24.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:24.818 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:24.881 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:24.986+0000 7f0dc3e172c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:26:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:24.987+0000 7f0dc3e172c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:26:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:24.987+0000 7f0dc3e172c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:24.987+0000 7f0dc3e172c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:24.987+0000 7f0dc3e172c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:24.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:24.989+0000 7f0dc3e172c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:26:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:25.532+0000 7f0dc3e172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:26.293+0000 7f0dc3e172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:27.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:27.064+0000 7f0dc3e172c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:27.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:27.950 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.037+0000 7f0427d4c2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:26:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.037+0000 7f0427d4c2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:26:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.037+0000 7f0427d4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.038+0000 7f0427d4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:28.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.038+0000 7f0427d4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:28.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.039+0000 7f0427d4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:26:28.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:28.586+0000 7f0427d4c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:29.355+0000 7f0427d4c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:30.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:30.126+0000 7f0427d4c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:30.963 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:31.021 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.106+0000 7f6d7a71d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:26:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.107+0000 7f6d7a71d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:26:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.107+0000 7f6d7a71d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.107+0000 7f6d7a71d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.107+0000 7f6d7a71d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:31.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.108+0000 7f6d7a71d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:26:31.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:31.651+0000 7f6d7a71d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:32.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:32.422+0000 7f6d7a71d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:33.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:33.195+0000 7f6d7a71d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:34.033 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:34.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.181+0000 7f18cf00e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.181+0000 7f18cf00e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.181+0000 7f18cf00e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:34.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.181+0000 7f18cf00e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:34.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.181+0000 7f18cf00e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:34.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.183+0000 7f18cf00e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:26:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:34.725+0000 7f18cf00e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:35.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:35.495+0000 7f18cf00e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:36.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:36.266+0000 7f18cf00e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:37.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:37.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:37.241 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:37.241 INFO:tasks.ceph:role: osd.4 2024-08-17T02:26:37.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:26:37.241 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:26:37.306 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:37.306 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:37.307 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:37.700 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-08-17T02:26:37.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-08-17T02:26:37.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:37.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:37.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:37.975 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:37.975 INFO:tasks.ceph:role: osd.5 2024-08-17T02:26:37.975 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:26:37.975 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:26:38.043 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:38.044 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:38.400 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-08-17T02:26:38.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-08-17T02:26:38.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:38.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:38.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:38.605 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:38.605 INFO:tasks.ceph:role: osd.6 2024-08-17T02:26:38.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:26:38.606 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:26:38.668 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:38.668 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:38.668 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:38.668 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:38.669 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:38.669 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:38.669 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:38.669 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:38.669 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:38.669 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:39.054 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-08-17T02:26:39.058 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-08-17T02:26:39.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:39.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:39.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:39.275 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:39.275 INFO:tasks.ceph:role: osd.7 2024-08-17T02:26:39.275 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:26:39.275 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:26:39.338 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:39.338 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:39.339 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:39.754 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-08-17T02:26:39.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-08-17T02:26:39.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:39.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:39.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.060+0000 7fc1aa63b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:26:40.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.063+0000 7fc1aa63b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:26:40.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.063+0000 7fc1aa63b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:26:40.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.063+0000 7fc1aa63b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:26:40.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.063+0000 7fc1aa63b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:26:40.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.071+0000 7fc1aa63b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:26:40.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:40.618+0000 7fc1aa63b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:41.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:41.387+0000 7fc1aa63b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:42.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:42.164+0000 7fc1aa63b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:42.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:26:43.053 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:43.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.136+0000 7fc46d63f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:26:43.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.137+0000 7fc46d63f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:26:43.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.137+0000 7fc46d63f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:26:43.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.137+0000 7fc46d63f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:26:43.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.137+0000 7fc46d63f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:26:43.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.139+0000 7fc46d63f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:26:43.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:43.682+0000 7fc46d63f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:44.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:44.451+0000 7fc46d63f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:45.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:45.219+0000 7fc46d63f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:46.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:26:46.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.191+0000 7f326320e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:26:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.191+0000 7f326320e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:26:46.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.192+0000 7f326320e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.192+0000 7f326320e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:46.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.192+0000 7f326320e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:26:46.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.193+0000 7f326320e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:26:46.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:46.743+0000 7f326320e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:47.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:47.516+0000 7f326320e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:48.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:48.288+0000 7f326320e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:49.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:26:49.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.262+0000 7fa54db2a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:26:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.262+0000 7fa54db2a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:26:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.262+0000 7fa54db2a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:26:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.262+0000 7fa54db2a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:26:49.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.262+0000 7fa54db2a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:26:49.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.264+0000 7fa54db2a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:26:49.434 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:49.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:49.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:49.808+0000 7fa54db2a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:50.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:50.589+0000 7fa54db2a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:51.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:26:51.353+0000 7fa54db2a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:52.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:26:52.236 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:26:52.236 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.236 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:26:52.296 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.296 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:26:52.392 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.392 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:26:52.487 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.488 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:26:52.585 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.585 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:26:52.680 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:26:52.776 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:52.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:26:52.871 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:52.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:26:52.933 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:52.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:26:53.032 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:26:53.129 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.130 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:26:53.225 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:26:53.321 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.321 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:26:53.416 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:26:53.512 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:53.512 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:26:53.548 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:26:53.548 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:26:53.624 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.624 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:26:53.659 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:26:53.659 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:26:53.734 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:26:53.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:26:53.738 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBOCsBmqZPyIBAAy0vvidimLZn3HRtHNwac/g== 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBOCsBmTNHCLRAAZWCcymcwTmLh7d+sbTs6Lg== 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBOCsBm5RJSNxAAKzpmsJO/A4cDRkTsAIJOcw== 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBQCsBmm7jaOhAAuNYlUk2B5eukzP/JWQFrNg== 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-08-17T02:26:53.789 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBUCsBmQgJIAhAA10/C9DkcmiCyASCIQrmhZA== 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBXCsBm5eFnBhAApU29LKOHdL14PD0L2bhing== 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBaCsBmHb7UChAAfPwhKviTk09nYXy+t1fOUw== 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBOCsBmM+iCJxAAwCvDap8ssfkLqhUsFKKNjQ== 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBPCsBmkwcmBRAAArpoavwprRIqvNsasL3UPQ== 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBPCsBm5vafDhAAYXu0lzXhyJtK2Nm43JiCOQ== 2024-08-17T02:26:53.790 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBgCsBmI5OxAxAAGT8KGHjz9iBBmYoxKX7yUQ== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBjCsBmRpMxCBAAsW+4DMNa93INCAj84ntnaQ== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBmCsBmhGJ6CxAApmGjpDRGcE6SNh6E9ro/zw== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBpCsBmauCzDxAAfsASZsMvR+/r6D7LFZXyxw== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBPCsBmrPPBFhAAE9cXDJE9M8YaYoGLEerUGw== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[client.2] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBPCsBmPtvXHBAAhb/CT/SPQo9RiJBqdFQf+A== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[client.1] 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBPCsBmvr/kIhAAGGyGmboL+4ssKORkdwzDBw== 2024-08-17T02:26:53.791 INFO:teuthology.orchestra.run.smithi042.stdout:[client.3] 2024-08-17T02:26:53.792 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBPCsBmB6n4KBAAo3Z+O6mBlbuDxra06Ux/JQ== 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBOCsBmqZPyIBAAy0vvidimLZn3HRtHNwac/g== 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBOCsBmTNHCLRAAZWCcymcwTmLh7d+sbTs6Lg== 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBOCsBm5RJSNxAAKzpmsJO/A4cDRkTsAIJOcw== 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBQCsBmm7jaOhAAuNYlUk2B5eukzP/JWQFrNg== 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBUCsBmQgJIAhAA10/C9DkcmiCyASCIQrmhZA== 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBXCsBm5eFnBhAApU29LKOHdL14PD0L2bhing== 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBaCsBmHb7UChAAfPwhKviTk09nYXy+t1fOUw== 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBOCsBmM+iCJxAAwCvDap8ssfkLqhUsFKKNjQ== 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBPCsBmkwcmBRAAArpoavwprRIqvNsasL3UPQ== 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBPCsBm5vafDhAAYXu0lzXhyJtK2Nm43JiCOQ== 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBgCsBmI5OxAxAAGT8KGHjz9iBBmYoxKX7yUQ== 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBjCsBmRpMxCBAAsW+4DMNa93INCAj84ntnaQ== 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBmCsBmhGJ6CxAApmGjpDRGcE6SNh6E9ro/zw== 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBpCsBmauCzDxAAfsASZsMvR+/r6D7LFZXyxw== 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBPCsBmrPPBFhAAE9cXDJE9M8YaYoGLEerUGw== 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout:[client.2] 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBPCsBmPtvXHBAAhb/CT/SPQo9RiJBqdFQf+A== 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBPCsBmvr/kIhAAGGyGmboL+4ssKORkdwzDBw== 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout:[client.3] 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBPCsBmB6n4KBAAo3Z+O6mBlbuDxra06Ux/JQ== 2024-08-17T02:26:53.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:53.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:53.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:53.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.052 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.146 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.238 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.419 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.510 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:54.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:26:54.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:26:54.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.880 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:54.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:55.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:55.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:26:55.156 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.344 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:26:55.533 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:26:55.533 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:26:55.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:55.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:26:55.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:26:55.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:55.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:26:55.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:26:56.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:56.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:26:56.165 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:56.168 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:56.205 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:26:56.205 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:26:56.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:26:56.245 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:26:56.245 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:26:56.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:26:56.249 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:26:56.249 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:26:56.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:26:56.253 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:26:56.253 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:26:56.253 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:26:56.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:26:56.257 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:26:56.257 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:26:56.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:26:56.262 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:26:56.262 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:26:56.262 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:26:56.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.411+0000 7ff45ac00640 1 Processor -- start 2024-08-17T02:26:56.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.411+0000 7ff45ac00640 1 -- start start 2024-08-17T02:26:56.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.412+0000 7ff45ac00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.412+0000 7ff45ac00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.412+0000 7ff45ac00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45415b5e0 con 0x7ff4540ca050 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.412+0000 7ff45ac00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4540cb160 con 0x7ff4540add30 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.412+0000 7ff45ac00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4540b0d10 con 0x7ff4540ad960 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.412+0000 7ff458c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff458c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50502/0 (socket says 172.21.15.42:50502) 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 learned_addr learned my addr 172.21.15.42:0/3014407714 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff453400640 1 --1- 172.21.15.42:0/3014407714 >> v1:172.21.15.42:6789/0 conn(0x7ff4540ca050 0x7ff454156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:41422/0 (socket says 172.21.15.42:41422) 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:56.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:56.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:56.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:56.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:56.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:56.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:56.614+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:57.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.015+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:26:57.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.816+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.816+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:57.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.816+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.816+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.816+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.816+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.817+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:57.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.817+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.817+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:57.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:57.817+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 msgr2=0x7ff45415b0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff4540ad960 0x7ff45415b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff454156b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff454156b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v1:172.21.15.42:6789/0 conn(0x7ff4540ca050 legacy=0x7ff454156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:59.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4540ca550 con 0x7ff434006190 2024-08-17T02:26:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540cb160 con 0x7ff434003650 2024-08-17T02:26:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:59.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:26:59.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.614+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:59.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.614+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:26:59.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.614+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:26:59.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.614+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:26:59.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:26:59.614+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.016+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.016+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.016+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.016+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:00.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.016+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.817+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.817+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.817+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.817+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:00.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:00.817+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:27:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff434003650 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v1:172.21.15.62:6789/0 conn(0x7ff434006190 legacy=0x7ff434008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 reap_dead start 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43400afd0 con 0x7ff43400a510 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4540cb160 con 0x7ff4540add30 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4540b0d10 con 0x7ff43400aa60 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.413+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.414+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.414+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.414+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.414+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.414+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:02.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:02.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:02.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:02.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:02.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:02.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:02.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:02.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:02.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:02.615+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.016+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:03.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:03.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff453e00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:03.818+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:27:05.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 msgr2=0x7ff434005a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:05.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.62:3300/0 conn(0x7ff43400aa60 0x7ff434005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 msgr2=0x7ff434009fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> v2:172.21.15.42:3300/0 conn(0x7ff4540add30 0x7ff434009fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 >> v1:172.21.15.62:6789/0 conn(0x7ff43400a510 legacy=0x7ff43400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff434008ef0 con 0x7ff434009240 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.413+0000 7ff451600640 1 -- 172.21.15.42:0/3014407714 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540cb160 con 0x7ff4340097c0 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.414+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.414+0000 7ff453400640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.414+0000 7ff453400640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.414+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:05.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.414+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:05.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.615+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:05.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.615+0000 7ff453400640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:05.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.615+0000 7ff453400640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:05.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.615+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:05.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:05.615+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:06.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.017+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.017+0000 7ff453400640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:06.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.017+0000 7ff453400640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:06.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.017+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:06.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.017+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:06.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113264627 0 0) 0x7ff434008ef0 con 0x7ff434009240 2024-08-17T02:27:06.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4380034e0 con 0x7ff434009240 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 957310827 0 0) 0x7ff4380034e0 con 0x7ff434009240 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 msgr2=0x7ff434013a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff4340097c0 0x7ff434013a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434014fa0 con 0x7ff434009240 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7ff444017580 con 0x7ff434009240 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 >> v1:172.21.15.42:6789/0 conn(0x7ff434009240 legacy=0x7ff434008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 reap_dead start 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438003a00 0x7ff438003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438004780 0x7ff438004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438005250 0x7ff43800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540cb160 con 0x7ff438005250 2024-08-17T02:27:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43800c210 con 0x7ff438003a00 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.631+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43800c3d0 con 0x7ff438004780 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438005250 0x7ff43800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff453e00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438003a00 0x7ff438003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff453400640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438004780 0x7ff438004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438004780 msgr2=0x7ff438004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438004780 0x7ff438004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438003a00 msgr2=0x7ff438003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438003a00 0x7ff438003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.632+0000 7ff458c00640 1 -- 172.21.15.42:0/3014407714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380034e0 con 0x7ff438005250 2024-08-17T02:27:06.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.634+0000 7ff458c00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438005250 0x7ff43800b9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4540cb0d0 tx=0x7ff44c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f0f38346461760 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.635+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c02e070 con 0x7ff438005250 2024-08-17T02:27:06.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.635+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c00f040 con 0x7ff438005250 2024-08-17T02:27:06.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.635+0000 7ff452a00640 1 -- 172.21.15.42:0/3014407714 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c034400 con 0x7ff438005250 2024-08-17T02:27:06.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 -- 172.21.15.42:0/3014407714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438005250 msgr2=0x7ff43800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438005250 0x7ff43800b9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff4540cb0d0 tx=0x7ff44c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 -- 172.21.15.42:0/3014407714 shutdown_connections 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438005250 0x7ff43800b9d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438004780 0x7ff438004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3014407714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438003a00 0x7ff438003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 -- 172.21.15.42:0/3014407714 >> 172.21.15.42:0/3014407714 conn(0x7ff454066e60 msgr2=0x7ff454067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 -- 172.21.15.42:0/3014407714 shutdown_connections 2024-08-17T02:27:06.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.636+0000 7ff45ac00640 1 -- 172.21.15.42:0/3014407714 wait complete. 2024-08-17T02:27:06.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.638+0000 7ff45ac00640 1 Processor -- start 2024-08-17T02:27:06.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.638+0000 7ff45ac00640 1 -- start start 2024-08-17T02:27:06.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff45ac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 0x7ff45416be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff45ac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438004780 0x7ff454168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff45ac00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438005250 0x7ff45406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:06.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff45ac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414ee00 con 0x7ff438003a00 2024-08-17T02:27:06.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff45ac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414eb20 con 0x7ff438004780 2024-08-17T02:27:06.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff45ac00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414fab0 con 0x7ff438005250 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff453e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 0x7ff45416be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff453e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 0x7ff45416be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58600/0 (socket says 172.21.15.42:58600) 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff453e00640 1 -- 172.21.15.42:0/3120192660 learned_addr learned my addr 172.21.15.42:0/3120192660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.640+0000 7ff453400640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438004780 0x7ff454168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff458c00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438005250 0x7ff45406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff453e00640 1 -- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438005250 msgr2=0x7ff45406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff453e00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438005250 0x7ff45406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff453e00640 1 -- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438004780 msgr2=0x7ff454168ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff453e00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438004780 0x7ff454168ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff453e00640 1 -- 172.21.15.42:0/3120192660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45414fd90 con 0x7ff438003a00 2024-08-17T02:27:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.641+0000 7ff453e00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 0x7ff45416be00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff44400f2f0 tx=0x7ff44401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.642+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444029070 con 0x7ff438003a00 2024-08-17T02:27:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.642+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444021040 con 0x7ff438003a00 2024-08-17T02:27:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.642+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444020050 con 0x7ff438003a00 2024-08-17T02:27:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.642+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff454150070 con 0x7ff438003a00 2024-08-17T02:27:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.642+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45406b110 con 0x7ff438003a00 2024-08-17T02:27:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.643+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff444019550 con 0x7ff438003a00 2024-08-17T02:27:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.643+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff4440187a0 con 0x7ff438003a00 2024-08-17T02:27:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.644+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff454063fb0 con 0x7ff438003a00 2024-08-17T02:27:06.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.647+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff444019230 con 0x7ff438003a00 2024-08-17T02:27:06.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.718+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff45414db80 con 0x7ff438003a00 2024-08-17T02:27:06.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.721+0000 7ff44b400640 1 -- 172.21.15.42:0/3120192660 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff44401b2e0 con 0x7ff438003a00 2024-08-17T02:27:06.722 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-08-17T02:27:06.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 msgr2=0x7ff45416be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:06.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 0x7ff45416be00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff44400f2f0 tx=0x7ff44401d040 comp rx=0 tx=0).stop 2024-08-17T02:27:06.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 shutdown_connections 2024-08-17T02:27:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff438005250 0x7ff45406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff438004780 0x7ff454168ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 --2- 172.21.15.42:0/3120192660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff438003a00 0x7ff45416be00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 >> 172.21.15.42:0/3120192660 conn(0x7ff454066e60 msgr2=0x7ff4540aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 shutdown_connections 2024-08-17T02:27:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:06.722+0000 7ff45ac00640 1 -- 172.21.15.42:0/3120192660 wait complete. 2024-08-17T02:27:06.739 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:27:06.739 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:27:06.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:27:06.773 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:06.772+0000 7f25de413ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:06.775 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:06.774+0000 7f3254917ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:06.796 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:27:06.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:27:06.894 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:27:06.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:27:06.933 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:06.932+0000 7f3254917ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:06.935 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:06.933+0000 7f25de413ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:06.990 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-08-17T02:27:06.990 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:27:06.995 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:06.995+0000 7f3254917ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:06.998 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:06.997+0000 7f25de413ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:07.053 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:27:07.053 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:27:07.109 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:27:07.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:27:07.205 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:27:07.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:27:07.292 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:07.291+0000 7f25de413ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:07.302 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-08-17T02:27:07.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:27:07.312 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:07.311+0000 7f3254917ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:07.345 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:07.344+0000 7f25de413ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:07.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new aaf84ea9-d493-4f52-aa1c-fd097035a165 0 2024-08-17T02:27:07.368 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:07.368+0000 7f3254917ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.515+0000 7ffaf6c00640 1 Processor -- start 2024-08-17T02:27:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.515+0000 7ffaf6c00640 1 -- start start 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffaf6c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffaf6c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00af9a0 con 0x7ffaf01589e0 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffaf6c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00ce740 con 0x7ffaf00cda30 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffaf6c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00af810 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffae7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffaf4c00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffaf00cda30 0x7ffaf00cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46660/0 (socket says 172.21.15.62:46660) 2024-08-17T02:27:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.516+0000 7ffaf4c00640 1 -- 172.21.15.62:0/3477663879 learned_addr learned my addr 172.21.15.62:0/3477663879 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-08-17T02:27:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.517+0000 7ffae7e00640 1 -- 172.21.15.62:0/3477663879 >> v1:172.21.15.62:6789/0 conn(0x7ffaf00cda30 legacy=0x7ffaf00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.517+0000 7ffae7e00640 1 -- 172.21.15.62:0/3477663879 >> v1:172.21.15.42:6789/0 conn(0x7ffaf01589e0 legacy=0x7ffaf00ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.517+0000 7ffae7e00640 1 -- 172.21.15.62:0/3477663879 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00cea00 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.517+0000 7ffaef400640 1 -- 172.21.15.62:0/3477663879 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560071534 0 0) 0x7ffaf00ce740 con 0x7ffaf00cda30 2024-08-17T02:27:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.519+0000 7ffae7e00640 1 --2- 172.21.15.62:0/3477663879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf0158db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009880 tx=0x7ffad80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d794936d58817d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.519+0000 7ffaef400640 1 -- 172.21.15.62:0/3477663879 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad802ac40 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.519+0000 7ffaef400640 1 -- 172.21.15.62:0/3477663879 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad802ada0 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.519+0000 7ffaef400640 1 -- 172.21.15.62:0/3477663879 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8032670 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3477663879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 msgr2=0x7ffaf0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 --2- 172.21.15.62:0/3477663879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf0158db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009880 tx=0x7ffad80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3477663879 shutdown_connections 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 --2- 172.21.15.62:0/3477663879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf0158db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3477663879 >> 172.21.15.62:0/3477663879 conn(0x7ffaf006e590 msgr2=0x7ffaf006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3477663879 shutdown_connections 2024-08-17T02:27:07.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.521+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3477663879 wait complete. 2024-08-17T02:27:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 Processor -- start 2024-08-17T02:27:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 -- start start 2024-08-17T02:27:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaf00cda30 0x7ffaf00c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf01589e0 0x7ffaf0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00c83a0 con 0x7ffaf00cda30 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00c7b00 con 0x7ffaf01589e0 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.522+0000 7ffaf6c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00c7de0 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffae7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaf00cda30 0x7ffaf00c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf015b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40100/0 (socket says 172.21.15.62:40100) 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 -- 172.21.15.62:0/3100417098 learned_addr learned my addr 172.21.15.62:0/3100417098 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaf4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf01589e0 0x7ffaf0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 -- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf01589e0 msgr2=0x7ffaf0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf01589e0 0x7ffaf0151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 -- 172.21.15.62:0/3100417098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaf00cda30 msgr2=0x7ffaf00c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaf00cda30 0x7ffaf00c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 -- 172.21.15.62:0/3100417098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad8009390 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.523+0000 7ffaefe00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf015b150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c7e0 tx=0x7ffae0007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000a640 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae000a7a0 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf00c80c0 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000aba0 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf015b690 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ffae0012420 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.524+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffae001b750 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.526+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf0063fb0 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.529+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ffae0012860 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.605+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aaf84ea9-d493-4f52-aa1c-fd097035a165", "id": 0} v 0) v1 -- 0x7ffaf0068f10 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.609+0000 7ffae7400640 1 -- 172.21.15.62:0/3100417098 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aaf84ea9-d493-4f52-aa1c-fd097035a165", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffae0012a00 con 0x7ffaf00cb0d0 2024-08-17T02:27:07.609 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 msgr2=0x7ffaf015b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf015b150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c7e0 tx=0x7ffae0007eb0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 shutdown_connections 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf01589e0 0x7ffaf0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffaf00cda30 0x7ffaf00c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 --2- 172.21.15.62:0/3100417098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf00cb0d0 0x7ffaf015b150 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 >> 172.21.15.62:0/3100417098 conn(0x7ffaf006e590 msgr2=0x7ffaf00b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 shutdown_connections 2024-08-17T02:27:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.610+0000 7ffaf6c00640 1 -- 172.21.15.62:0/3100417098 wait complete. 2024-08-17T02:27:07.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 0e3c516d-4947-4360-a33d-38019a85176b 1 2024-08-17T02:27:07.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.773+0000 7fba00c00640 1 Processor -- start 2024-08-17T02:27:07.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.774+0000 7fba00c00640 1 -- start start 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.775+0000 7fba00c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb9fc158f20 0x7fb9fc062f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.775+0000 7fba00c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb9fc15a950 0x7fb9fc0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fba00c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc0a9a90 con 0x7fb9fc0a9630 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fba00c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc067510 con 0x7fb9fc158f20 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fba00c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc066f00 con 0x7fb9fc15a950 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb9fc15a950 0x7fb9fc0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb9fc15a950 0x7fb9fc0a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50022/0 (socket says 172.21.15.62:50022) 2024-08-17T02:27:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 -- 172.21.15.62:0/2184216097 learned_addr learned my addr 172.21.15.62:0/2184216097 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9e00640 1 --2- 172.21.15.62:0/2184216097 >> v2:172.21.15.42:3300/0 conn(0x7fb9fc158f20 0x7fb9fc062f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 -- 172.21.15.62:0/2184216097 >> v2:172.21.15.42:3300/0 conn(0x7fb9fc158f20 msgr2=0x7fb9fc062f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 --2- 172.21.15.62:0/2184216097 >> v2:172.21.15.42:3300/0 conn(0x7fb9fc158f20 0x7fb9fc062f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 -- 172.21.15.62:0/2184216097 >> v1:172.21.15.42:6789/0 conn(0x7fb9fc0a9630 legacy=0x7fb9fc0679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.776+0000 7fb9f9400640 1 -- 172.21.15.62:0/2184216097 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0ccda0 con 0x7fb9fc15a950 2024-08-17T02:27:07.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.777+0000 7fb9f9400640 1 --2- 172.21.15.62:0/2184216097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0a90f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc095d10 tx=0x7fb9e80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a959048d826430 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.778+0000 7fb9f8a00640 1 -- 172.21.15.62:0/2184216097 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e802ae80 con 0x7fb9fc15a950 2024-08-17T02:27:07.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.778+0000 7fb9f8a00640 1 -- 172.21.15.62:0/2184216097 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8032440 con 0x7fb9fc15a950 2024-08-17T02:27:07.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.778+0000 7fb9f8a00640 1 -- 172.21.15.62:0/2184216097 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8032800 con 0x7fb9fc15a950 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 -- 172.21.15.62:0/2184216097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc15a950 msgr2=0x7fb9fc0a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 --2- 172.21.15.62:0/2184216097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0a90f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc095d10 tx=0x7fb9e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 -- 172.21.15.62:0/2184216097 shutdown_connections 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 --2- 172.21.15.62:0/2184216097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0a90f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 --2- 172.21.15.62:0/2184216097 >> v2:172.21.15.42:3300/0 conn(0x7fb9fc158f20 0x7fb9fc062f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 -- 172.21.15.62:0/2184216097 >> 172.21.15.62:0/2184216097 conn(0x7fb9fc06e5b0 msgr2=0x7fb9fc0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 -- 172.21.15.62:0/2184216097 shutdown_connections 2024-08-17T02:27:07.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.779+0000 7fba00c00640 1 -- 172.21.15.62:0/2184216097 wait complete. 2024-08-17T02:27:07.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.781+0000 7fba00c00640 1 Processor -- start 2024-08-17T02:27:07.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.781+0000 7fba00c00640 1 -- start start 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fba00c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9fc0a9630 0x7fb9fc1455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fba00c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 0x7fb9fc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fba00c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fba00c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc169f30 con 0x7fb9fc15a950 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fba00c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc096bc0 con 0x7fb9fc158f20 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fba00c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc096290 con 0x7fb9fc0a9630 2024-08-17T02:27:07.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 0x7fb9fc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9fc0a9630 0x7fb9fc1455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 0x7fb9fc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50026/0 (socket says 172.21.15.62:50026) 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9400640 1 -- 172.21.15.62:0/1063814069 learned_addr learned my addr 172.21.15.62:0/1063814069 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9fa800640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9e00640 1 -- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 msgr2=0x7fb9fc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9e00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 0x7fb9fc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9e00640 1 -- 172.21.15.62:0/1063814069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9fc15a950 msgr2=0x7fb9fc0ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9e00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9e00640 1 -- 172.21.15.62:0/1063814069 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8009450 con 0x7fb9fc0a9630 2024-08-17T02:27:07.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.782+0000 7fb9f9400640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 0x7fb9fc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:07.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.783+0000 7fb9f9e00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9fc0a9630 0x7fb9fc1455c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e990 tx=0x7fb9ec0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:07.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.783+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00c940 con 0x7fb9fc0a9630 2024-08-17T02:27:07.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.783+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00caa0 con 0x7fb9fc0a9630 2024-08-17T02:27:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.783+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00ce40 con 0x7fb9fc0a9630 2024-08-17T02:27:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.783+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc096570 con 0x7fb9fc0a9630 2024-08-17T02:27:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.783+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc145b00 con 0x7fb9fc0a9630 2024-08-17T02:27:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.784+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb9ec005970 con 0x7fb9fc0a9630 2024-08-17T02:27:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.784+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb9ec013d80 con 0x7fb9fc0a9630 2024-08-17T02:27:07.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.784+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc145d50 con 0x7fb9fc0a9630 2024-08-17T02:27:07.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.788+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb9ec021060 con 0x7fb9fc0a9630 2024-08-17T02:27:07.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.865+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0e3c516d-4947-4360-a33d-38019a85176b", "id": 1} v 0) v1 -- 0x7fb9fc095fe0 con 0x7fb9fc0a9630 2024-08-17T02:27:07.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.869+0000 7fb9f1600640 1 -- 172.21.15.62:0/1063814069 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e3c516d-4947-4360-a33d-38019a85176b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9ec017070 con 0x7fb9fc0a9630 2024-08-17T02:27:07.869 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9fc0a9630 msgr2=0x7fb9fc1455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9fc0a9630 0x7fb9fc1455c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e990 tx=0x7fb9ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 shutdown_connections 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9fc15a950 0x7fb9fc0ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9fc158f20 0x7fb9fc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 --2- 172.21.15.62:0/1063814069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9fc0a9630 0x7fb9fc1455c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 >> 172.21.15.62:0/1063814069 conn(0x7fb9fc06e5b0 msgr2=0x7fb9fc159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 shutdown_connections 2024-08-17T02:27:07.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:07.870+0000 7fba00c00640 1 -- 172.21.15.62:0/1063814069 wait complete. 2024-08-17T02:27:07.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 9b26ddac-f10a-4ec1-81e2-94c37068d7ec 2 2024-08-17T02:27:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.034+0000 7f89be000640 1 Processor -- start 2024-08-17T02:27:08.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.035+0000 7f89be000640 1 -- start start 2024-08-17T02:27:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89be000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b81589e0 0x7f89b8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89be000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89b80ca9c0 0x7f89b80cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89be000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f89b80cda30 0x7f89b80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89be000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80af810 con 0x7f89b80cda30 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89be000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b80af9a0 con 0x7f89b80ca9c0 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89be000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80cb310 con 0x7f89b81589e0 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89b7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b81589e0 0x7f89b8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89b6a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89b80ca9c0 0x7f89b80cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89b7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b81589e0 0x7f89b8158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40128/0 (socket says 172.21.15.62:40128) 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89b7400640 1 -- 172.21.15.62:0/2289079621 learned_addr learned my addr 172.21.15.62:0/2289079621 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.036+0000 7f89b7e00640 1 --2- 172.21.15.62:0/2289079621 >> v2:172.21.15.42:3300/0 conn(0x7f89b80cda30 0x7f89b80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.037+0000 7f89b6a00640 1 -- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b81589e0 msgr2=0x7f89b8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.037+0000 7f89b6a00640 1 --2- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b81589e0 0x7f89b8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.037+0000 7f89b6a00640 1 -- 172.21.15.62:0/2289079621 >> v2:172.21.15.42:3300/0 conn(0x7f89b80cda30 msgr2=0x7f89b80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.037+0000 7f89b6a00640 1 --2- 172.21.15.62:0/2289079621 >> v2:172.21.15.42:3300/0 conn(0x7f89b80cda30 0x7f89b80cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.037+0000 7f89b6a00640 1 -- 172.21.15.62:0/2289079621 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b80ce740 con 0x7f89b80ca9c0 2024-08-17T02:27:08.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.037+0000 7f89b7e00640 1 --2- 172.21.15.62:0/2289079621 >> v2:172.21.15.42:3300/0 conn(0x7f89b80cda30 0x7f89b80cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.038+0000 7f89b6a00640 1 --2- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80ca9c0 0x7f89b80cadd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89b8088b50 tx=0x7f89a40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf11fca4cfa4aec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.038+0000 7f89b6000640 1 -- 172.21.15.62:0/2289079621 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a402ad00 con 0x7f89b80ca9c0 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.038+0000 7f89b6000640 1 -- 172.21.15.62:0/2289079621 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a402ae60 con 0x7f89b80ca9c0 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.038+0000 7f89b6000640 1 -- 172.21.15.62:0/2289079621 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4032670 con 0x7f89b80ca9c0 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 -- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80ca9c0 msgr2=0x7f89b80cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 --2- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80ca9c0 0x7f89b80cadd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f89b8088b50 tx=0x7f89a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 -- 172.21.15.62:0/2289079621 shutdown_connections 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 --2- 172.21.15.62:0/2289079621 >> v2:172.21.15.42:3300/0 conn(0x7f89b80cda30 0x7f89b80cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 --2- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b80ca9c0 0x7f89b80cadd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 --2- 172.21.15.62:0/2289079621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b81589e0 0x7f89b8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 -- 172.21.15.62:0/2289079621 >> 172.21.15.62:0/2289079621 conn(0x7f89b806e590 msgr2=0x7f89b806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 -- 172.21.15.62:0/2289079621 shutdown_connections 2024-08-17T02:27:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.039+0000 7f89be000640 1 -- 172.21.15.62:0/2289079621 wait complete. 2024-08-17T02:27:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.041+0000 7f89be000640 1 Processor -- start 2024-08-17T02:27:08.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.041+0000 7f89be000640 1 -- start start 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89be000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89b80ca9c0 0x7f89b8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89be000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 0x7f89b8145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89be000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b81589e0 0x7f89b81456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89be000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80c9dc0 con 0x7f89b80ca9c0 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89be000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80c9800 con 0x7f89b81589e0 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89be000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80c9ae0 con 0x7f89b80cda30 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89b7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b81589e0 0x7f89b81456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89b6a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 0x7f89b8145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89b6a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 0x7f89b8145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40134/0 (socket says 172.21.15.62:40134) 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89b6a00640 1 -- 172.21.15.62:0/572416703 learned_addr learned my addr 172.21.15.62:0/572416703 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:08.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.042+0000 7f89b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89b80ca9c0 0x7f89b8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b7e00640 1 -- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 msgr2=0x7f89b8145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b7e00640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 0x7f89b8145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b7e00640 1 -- 172.21.15.62:0/572416703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89b80ca9c0 msgr2=0x7f89b8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b7e00640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89b80ca9c0 0x7f89b8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b7e00640 1 -- 172.21.15.62:0/572416703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0009a20 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b6a00640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 0x7f89b8145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89b7e00640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b81589e0 0x7f89b81456c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009f10 tx=0x7f89b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000cdb0 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000f040 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b00146d0 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4009390 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.043+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b80b2ec0 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.044+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f89b0003020 con 0x7f89b81589e0 2024-08-17T02:27:08.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.044+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f89b001d410 con 0x7f89b81589e0 2024-08-17T02:27:08.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.044+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80b3110 con 0x7f89b81589e0 2024-08-17T02:27:08.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.047+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f89b0018030 con 0x7f89b81589e0 2024-08-17T02:27:08.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.123+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b26ddac-f10a-4ec1-81e2-94c37068d7ec", "id": 2} v 0) v1 -- 0x7f89b8063fb0 con 0x7f89b81589e0 2024-08-17T02:27:08.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.127+0000 7f89aea00640 1 -- 172.21.15.62:0/572416703 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b26ddac-f10a-4ec1-81e2-94c37068d7ec", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89b0014e10 con 0x7f89b81589e0 2024-08-17T02:27:08.127 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b81589e0 msgr2=0x7f89b81456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b81589e0 0x7f89b81456c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009f10 tx=0x7f89b000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 shutdown_connections 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89b81589e0 0x7f89b81456c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89b80cda30 0x7f89b8145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 --2- 172.21.15.62:0/572416703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89b80ca9c0 0x7f89b8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 >> 172.21.15.62:0/572416703 conn(0x7f89b806e590 msgr2=0x7f89b8156510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 shutdown_connections 2024-08-17T02:27:08.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.128+0000 7f89be000640 1 -- 172.21.15.62:0/572416703 wait complete. 2024-08-17T02:27:08.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 2e0c1b8f-106c-4787-bc7f-37b1159ecb11 3 2024-08-17T02:27:08.206 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.205+0000 7f25de413ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:08.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.287+0000 7fbbb5c00640 1 Processor -- start 2024-08-17T02:27:08.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.288+0000 7fbbb5c00640 1 -- start start 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbb5c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbbb00ad960 0x7fbbb015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbb5c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbb5c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb015b5e0 con 0x7fbbb00ca050 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbb5c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00cb160 con 0x7fbbb00ad960 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbb5c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b0d10 con 0x7fbbb00add30 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbae000640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbbb00ca050 0x7fbbb0156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46662/0 (socket says 172.21.15.62:46662) 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbae000640 1 -- 172.21.15.62:0/2185446857 learned_addr learned my addr 172.21.15.62:0/2185446857 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbaf400640 1 --2- 172.21.15.62:0/2185446857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.289+0000 7fbbaea00640 1 --2- 172.21.15.62:0/2185446857 >> v2:172.21.15.42:3300/0 conn(0x7fbbb00ad960 0x7fbbb015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.290+0000 7fbbad600640 1 -- 172.21.15.62:0/2185446857 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302817176 0 0) 0x7fbb9c001110 con 0x7fbbb00ca050 2024-08-17T02:27:08.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.290+0000 7fbbaf400640 1 -- 172.21.15.62:0/2185446857 >> v2:172.21.15.42:3300/0 conn(0x7fbbb00ad960 msgr2=0x7fbbb015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.290+0000 7fbbaf400640 1 --2- 172.21.15.62:0/2185446857 >> v2:172.21.15.42:3300/0 conn(0x7fbbb00ad960 0x7fbbb015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.290+0000 7fbbaf400640 1 -- 172.21.15.62:0/2185446857 >> v1:172.21.15.62:6789/0 conn(0x7fbbb00ca050 legacy=0x7fbbb0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.290+0000 7fbbaf400640 1 -- 172.21.15.62:0/2185446857 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00ca550 con 0x7fbbb00add30 2024-08-17T02:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.291+0000 7fbbaf400640 1 --2- 172.21.15.62:0/2185446857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb0156b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009e60 tx=0x7fbba8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2b75b641cf8a86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbad600640 1 -- 172.21.15.62:0/2185446857 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8007550 con 0x7fbbb00add30 2024-08-17T02:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbad600640 1 -- 172.21.15.62:0/2185446857 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba802d050 con 0x7fbbb00add30 2024-08-17T02:27:08.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbad600640 1 -- 172.21.15.62:0/2185446857 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8007900 con 0x7fbbb00add30 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbb5c00640 1 -- 172.21.15.62:0/2185446857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 msgr2=0x7fbbb0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/2185446857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb0156b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009e60 tx=0x7fbba8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbb5c00640 1 -- 172.21.15.62:0/2185446857 shutdown_connections 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/2185446857 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb0156b30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/2185446857 >> v2:172.21.15.42:3300/0 conn(0x7fbbb00ad960 0x7fbbb015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.292+0000 7fbbb5c00640 1 -- 172.21.15.62:0/2185446857 >> 172.21.15.62:0/2185446857 conn(0x7fbbb0066e60 msgr2=0x7fbbb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.293+0000 7fbbb5c00640 1 -- 172.21.15.62:0/2185446857 shutdown_connections 2024-08-17T02:27:08.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.293+0000 7fbbb5c00640 1 -- 172.21.15.62:0/2185446857 wait complete. 2024-08-17T02:27:08.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.295+0000 7fbbb5c00640 1 Processor -- start 2024-08-17T02:27:08.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.295+0000 7fbbb5c00640 1 -- start start 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.296+0000 7fbbb5c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 0x7fbbb014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbb5c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb00acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbb5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbb00ca050 0x7fbbb015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbb5c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00aca30 con 0x7fbbb00ca050 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbb5c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0152630 con 0x7fbbb00ad960 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbb5c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00ac3e0 con 0x7fbbb00add30 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 0x7fbbb014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 0x7fbbb014ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50052/0 (socket says 172.21.15.62:50052) 2024-08-17T02:27:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbae000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb00acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 -- 172.21.15.62:0/4225291085 learned_addr learned my addr 172.21.15.62:0/4225291085 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaf400640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbb00ca050 0x7fbbb015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 -- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 msgr2=0x7fbbb00acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb00acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 -- 172.21.15.62:0/4225291085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbb00ca050 msgr2=0x7fbbb015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbb00ca050 0x7fbbb015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbaea00640 1 -- 172.21.15.62:0/4225291085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009a20 con 0x7fbbb00ad960 2024-08-17T02:27:08.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.297+0000 7fbbae000640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb00acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.298+0000 7fbbaea00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 0x7fbbb014ff70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbba000e900 tx=0x7fbba00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.298+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba000c8e0 con 0x7fbbb00ad960 2024-08-17T02:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.298+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba000ca40 con 0x7fbbb00ad960 2024-08-17T02:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.298+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba000cde0 con 0x7fbbb00ad960 2024-08-17T02:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.298+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb00ac6c0 con 0x7fbbb00ad960 2024-08-17T02:27:08.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.298+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00ad400 con 0x7fbbb00ad960 2024-08-17T02:27:08.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.299+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbba0005970 con 0x7fbbb00ad960 2024-08-17T02:27:08.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.299+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fbba0013cb0 con 0x7fbbb00ad960 2024-08-17T02:27:08.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.299+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0063fb0 con 0x7fbbb00ad960 2024-08-17T02:27:08.301 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.302+0000 7f3254917ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:08.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.302+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbba0021060 con 0x7fbbb00ad960 2024-08-17T02:27:08.308 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.307+0000 7f25de413ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:08.359 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.358+0000 7f25de413ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:08.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.378+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e0c1b8f-106c-4787-bc7f-37b1159ecb11", "id": 3} v 0) v1 -- 0x7fbbb006dec0 con 0x7fbbb00ad960 2024-08-17T02:27:08.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.382+0000 7fbba6000640 1 -- 172.21.15.62:0/4225291085 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e0c1b8f-106c-4787-bc7f-37b1159ecb11", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbba0017070 con 0x7fbbb00ad960 2024-08-17T02:27:08.382 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-08-17T02:27:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 msgr2=0x7fbbb014ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 0x7fbbb014ff70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbba000e900 tx=0x7fbba00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 shutdown_connections 2024-08-17T02:27:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbb00ca050 0x7fbbb015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbbb00add30 0x7fbbb00acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 --2- 172.21.15.62:0/4225291085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00ad960 0x7fbbb014ff70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 >> 172.21.15.62:0/4225291085 conn(0x7fbbb0066e60 msgr2=0x7fbbb0153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 shutdown_connections 2024-08-17T02:27:08.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.383+0000 7fbbb5c00640 1 -- 172.21.15.62:0/4225291085 wait complete. 2024-08-17T02:27:08.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 309ca7ca-583c-40f7-aa3b-6e19b75f1753 4 2024-08-17T02:27:08.408 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.409+0000 7f3254917ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:08.460 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.461+0000 7f3254917ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:08.534 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.533+0000 7f25de413ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.543+0000 7f41e5400640 1 Processor -- start 2024-08-17T02:27:08.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.544+0000 7f41e5400640 1 -- start start 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41e5400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00aea20 0x7f41e00aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41e5400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f41e00ca8e0 0x7f41e00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41e5400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00af370 con 0x7f41e0158b90 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41e5400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e00afd20 con 0x7f41e00ca8e0 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41e5400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00affe0 con 0x7f41e00aea20 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41df200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f41e00ca8e0 0x7f41e00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41dde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00aea20 0x7f41e00aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41df200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f41e00ca8e0 0x7f41e00cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50056/0 (socket says 172.21.15.62:50056) 2024-08-17T02:27:08.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.545+0000 7f41df200640 1 -- 172.21.15.62:0/938544793 learned_addr learned my addr 172.21.15.62:0/938544793 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:08.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.546+0000 7f41df200640 1 -- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00aea20 msgr2=0x7f41e00aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.546+0000 7f41df200640 1 --2- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00aea20 0x7f41e00aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.546+0000 7f41df200640 1 -- 172.21.15.62:0/938544793 >> v1:172.21.15.42:6789/0 conn(0x7f41e0158b90 legacy=0x7f41e00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.546+0000 7f41dd400640 1 -- 172.21.15.62:0/938544793 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951278798 0 0) 0x7f41e00af370 con 0x7f41e0158b90 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.546+0000 7f41df200640 1 -- 172.21.15.62:0/938544793 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00b02c0 con 0x7f41e00ca8e0 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.546+0000 7f41dde00640 1 --2- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00aea20 0x7f41e00aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.547+0000 7f41df200640 1 --2- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e00ca8e0 0x7f41e00cad00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009f20 tx=0x7f41d8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92be7349e041184 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.547+0000 7f41dd400640 1 -- 172.21.15.62:0/938544793 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8031400 con 0x7f41e00ca8e0 2024-08-17T02:27:08.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.548+0000 7f41dd400640 1 -- 172.21.15.62:0/938544793 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d802d050 con 0x7f41e00ca8e0 2024-08-17T02:27:08.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.548+0000 7f41dd400640 1 -- 172.21.15.62:0/938544793 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8031790 con 0x7f41e00ca8e0 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.548+0000 7f41e5400640 1 -- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e00ca8e0 msgr2=0x7f41e00cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.548+0000 7f41e5400640 1 --2- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e00ca8e0 0x7f41e00cad00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f41d8009f20 tx=0x7f41d8009840 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.549+0000 7f41e5400640 1 -- 172.21.15.62:0/938544793 shutdown_connections 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.549+0000 7f41e5400640 1 --2- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e00ca8e0 0x7f41e00cad00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.549+0000 7f41e5400640 1 --2- 172.21.15.62:0/938544793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00aea20 0x7f41e00aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.549+0000 7f41e5400640 1 -- 172.21.15.62:0/938544793 >> 172.21.15.62:0/938544793 conn(0x7f41e006e590 msgr2=0x7f41e006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.549+0000 7f41e5400640 1 -- 172.21.15.62:0/938544793 shutdown_connections 2024-08-17T02:27:08.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.549+0000 7f41e5400640 1 -- 172.21.15.62:0/938544793 wait complete. 2024-08-17T02:27:08.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.550+0000 7f41e5400640 1 Processor -- start 2024-08-17T02:27:08.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.550+0000 7f41e5400640 1 -- start start 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41e5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e00aea20 0x7f41e00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41e5400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 0x7f41e016c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41e5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e0158b90 0x7f41e00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41e5400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00c7e90 con 0x7f41e00aea20 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41e5400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e015ee30 con 0x7f41e0158b90 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41e5400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e016caf0 con 0x7f41e00ca8e0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41dde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 0x7f41e016c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41de800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e00aea20 0x7f41e00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41dde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 0x7f41e016c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40160/0 (socket says 172.21.15.62:40160) 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41dde00640 1 -- 172.21.15.62:0/328957018 learned_addr learned my addr 172.21.15.62:0/328957018 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.551+0000 7f41df200640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e0158b90 0x7f41e00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41dde00640 1 -- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e0158b90 msgr2=0x7f41e00c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41dde00640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e0158b90 0x7f41e00c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41dde00640 1 -- 172.21.15.62:0/328957018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e00aea20 msgr2=0x7f41e00c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41dde00640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e00aea20 0x7f41e00c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41dde00640 1 -- 172.21.15.62:0/328957018 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009390 con 0x7f41e00ca8e0 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41de800640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e00aea20 0x7f41e00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41dde00640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 0x7f41e016c5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00eaa0 tx=0x7f41cc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.552+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00ca10 con 0x7f41e00ca8e0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.553+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00cb70 con 0x7f41e00ca8e0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.553+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc013470 con 0x7f41e00ca8e0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.553+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d8009ae0 con 0x7f41e00ca8e0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.553+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e015df60 con 0x7f41e00ca8e0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.553+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f41cc005970 con 0x7f41e00ca8e0 2024-08-17T02:27:08.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.553+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f41cc005c20 con 0x7f41e00ca8e0 2024-08-17T02:27:08.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.554+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0063fb0 con 0x7f41e00ca8e0 2024-08-17T02:27:08.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.556+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f41cc021060 con 0x7f41e00ca8e0 2024-08-17T02:27:08.591 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.590+0000 7f25de413ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:08.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.633+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "309ca7ca-583c-40f7-aa3b-6e19b75f1753", "id": 4} v 0) v1 -- 0x7f41e00008d0 con 0x7f41e00ca8e0 2024-08-17T02:27:08.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.637+0000 7f41d6000640 1 -- 172.21.15.62:0/328957018 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "309ca7ca-583c-40f7-aa3b-6e19b75f1753", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f41cc029020 con 0x7f41e00ca8e0 2024-08-17T02:27:08.637 INFO:teuthology.orchestra.run.smithi062.stdout:4 2024-08-17T02:27:08.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 msgr2=0x7f41e016c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 0x7f41e016c5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00eaa0 tx=0x7f41cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 shutdown_connections 2024-08-17T02:27:08.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41e0158b90 0x7f41e00c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41e00ca8e0 0x7f41e016c5b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 --2- 172.21.15.62:0/328957018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e00aea20 0x7f41e00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 >> 172.21.15.62:0/328957018 conn(0x7f41e006e590 msgr2=0x7f41e00cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 shutdown_connections 2024-08-17T02:27:08.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.638+0000 7f41e5400640 1 -- 172.21.15.62:0/328957018 wait complete. 2024-08-17T02:27:08.644 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.644+0000 7f3254917ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:08.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 47e39f90-3172-4ff7-b9a0-2964183c02fc 5 2024-08-17T02:27:08.654 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.653+0000 7f25de413ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:08.714 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.714+0000 7f3254917ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:08.766 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:08.764+0000 7f25de413ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:08.778 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.779+0000 7f3254917ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.841+0000 7f05cbc00640 1 Processor -- start 2024-08-17T02:27:08.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.841+0000 7f05cbc00640 1 -- start start 2024-08-17T02:27:08.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05cbc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05c41589e0 0x7f05c4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05cbc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c40cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05cbc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c40af9a0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05cbc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c40af810 con 0x7f05c41589e0 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05cbc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40cb340 con 0x7f05c40ce140 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05c9200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05c41589e0 0x7f05c4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05c3e00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f05c40ca9c0 0x7f05c40cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46668/0 (socket says 172.21.15.62:46668) 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05c3e00640 1 -- 172.21.15.62:0/884756257 learned_addr learned my addr 172.21.15.62:0/884756257 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-08-17T02:27:08.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.843+0000 7f05c9c00640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c40cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.844+0000 7f05c9200640 1 -- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 msgr2=0x7f05c40cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.844+0000 7f05c9200640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c40cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.844+0000 7f05c9200640 1 -- 172.21.15.62:0/884756257 >> v1:172.21.15.62:6789/0 conn(0x7f05c40ca9c0 legacy=0x7f05c40cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.844+0000 7f05c9200640 1 -- 172.21.15.62:0/884756257 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40ce740 con 0x7f05c41589e0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.844+0000 7f05c3400640 1 -- 172.21.15.62:0/884756257 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402301055 0 0) 0x7f05c40af9a0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.844+0000 7f05c9c00640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c40cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.845+0000 7f05c9200640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c41589e0 0x7f05c4158db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009850 tx=0x7f05b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edfd4ce5699801a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.845+0000 7f05c3400640 1 -- 172.21.15.62:0/884756257 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b802ad80 con 0x7f05c41589e0 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.845+0000 7f05c3400640 1 -- 172.21.15.62:0/884756257 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8032440 con 0x7f05c41589e0 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.845+0000 7f05c3400640 1 -- 172.21.15.62:0/884756257 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80327e0 con 0x7f05c41589e0 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 -- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c41589e0 msgr2=0x7f05c4158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c41589e0 0x7f05c4158db0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009850 tx=0x7f05b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 -- 172.21.15.62:0/884756257 shutdown_connections 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c40cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 --2- 172.21.15.62:0/884756257 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c41589e0 0x7f05c4158db0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 -- 172.21.15.62:0/884756257 >> 172.21.15.62:0/884756257 conn(0x7f05c406e590 msgr2=0x7f05c406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 -- 172.21.15.62:0/884756257 shutdown_connections 2024-08-17T02:27:08.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.846+0000 7f05cbc00640 1 -- 172.21.15.62:0/884756257 wait complete. 2024-08-17T02:27:08.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.847+0000 7f05cbc00640 1 Processor -- start 2024-08-17T02:27:08.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.847+0000 7f05cbc00640 1 -- start start 2024-08-17T02:27:08.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.848+0000 7f05cbc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c40ca9c0 0x7f05c40c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.848+0000 7f05cbc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c41536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.848+0000 7f05cbc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c41589e0 0x7f05c4149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.848+0000 7f05cbc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40c7a00 con 0x7f05c41589e0 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.848+0000 7f05cbc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4152570 con 0x7f05c40ca9c0 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.848+0000 7f05cbc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c41533d0 con 0x7f05c40ce140 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c41536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c40ca9c0 0x7f05c40c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c41536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40172/0 (socket says 172.21.15.62:40172) 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c3e00640 1 -- 172.21.15.62:0/264883476 learned_addr learned my addr 172.21.15.62:0/264883476 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:08.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9c00640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c41589e0 0x7f05c4149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9200640 1 -- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 msgr2=0x7f05c41536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9200640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c41536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9200640 1 -- 172.21.15.62:0/264883476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c41589e0 msgr2=0x7f05c4149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9200640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c41589e0 0x7f05c4149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c9200640 1 -- 172.21.15.62:0/264883476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc009a20 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.849+0000 7f05c3e00640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05c9200640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c40ca9c0 0x7f05c40c74c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05c4088e20 tx=0x7f05b8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8031de0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b803d420 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b803d7e0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b8009390 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4152aa0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f05b8039040 con 0x7f05c40ca9c0 2024-08-17T02:27:08.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.850+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f05b8046a60 con 0x7f05c40ca9c0 2024-08-17T02:27:08.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.851+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c4063fb0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.854+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f05b8042070 con 0x7f05c40ca9c0 2024-08-17T02:27:08.894 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:08.895+0000 7f3254917ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:08.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.930+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47e39f90-3172-4ff7-b9a0-2964183c02fc", "id": 5} v 0) v1 -- 0x7f05c40c63a0 con 0x7f05c40ca9c0 2024-08-17T02:27:08.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.934+0000 7f05b7e00640 1 -- 172.21.15.62:0/264883476 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47e39f90-3172-4ff7-b9a0-2964183c02fc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f05b8037070 con 0x7f05c40ca9c0 2024-08-17T02:27:08.934 INFO:teuthology.orchestra.run.smithi062.stdout:5 2024-08-17T02:27:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c40ca9c0 msgr2=0x7f05c40c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c40ca9c0 0x7f05c40c74c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05c4088e20 tx=0x7f05b8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:08.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 shutdown_connections 2024-08-17T02:27:08.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c41589e0 0x7f05c4149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05c40ce140 0x7f05c41536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 --2- 172.21.15.62:0/264883476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05c40ca9c0 0x7f05c40c74c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:08.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 >> 172.21.15.62:0/264883476 conn(0x7f05c406e590 msgr2=0x7f05c414af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:08.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.935+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 shutdown_connections 2024-08-17T02:27:08.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:08.936+0000 7f05cbc00640 1 -- 172.21.15.62:0/264883476 wait complete. 2024-08-17T02:27:08.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new a4e2ad3a-18db-4267-974b-47ea6a5b67fe 6 2024-08-17T02:27:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.136+0000 7f90f4400640 1 Processor -- start 2024-08-17T02:27:09.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.136+0000 7f90f4400640 1 -- start start 2024-08-17T02:27:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.137+0000 7f90f4400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.137+0000 7f90f4400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 0x7f90ec0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f4400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0af9a0 con 0x7f90ec0cda30 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f4400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0af810 con 0x7f90ec0ca9c0 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f4400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0cb310 con 0x7f90ec1589e0 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 0x7f90ec0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40176/0 (socket says 172.21.15.62:40176) 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 0x7f90ec0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50096/0 (socket says 172.21.15.62:50096) 2024-08-17T02:27:09.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 -- 172.21.15.62:0/1654206295 learned_addr learned my addr 172.21.15.62:0/1654206295 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 -- 172.21.15.62:0/1654206295 >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 msgr2=0x7f90ec0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 --2- 172.21.15.62:0/1654206295 >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 0x7f90ec0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90ebe00640 1 -- 172.21.15.62:0/1654206295 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279320717 0 0) 0x7f90ec0af9a0 con 0x7f90ec0cda30 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 -- 172.21.15.62:0/1654206295 >> v1:172.21.15.42:6789/0 conn(0x7f90ec0cda30 legacy=0x7f90ec0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1a00640 1 -- 172.21.15.62:0/1654206295 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0ce740 con 0x7f90ec1589e0 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.138+0000 7f90f1000640 1 --2- 172.21.15.62:0/1654206295 >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 0x7f90ec0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.139+0000 7f90f1a00640 1 --2- 172.21.15.62:0/1654206295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec158db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009910 tx=0x7f90e00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66700f5b7441f445 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.140+0000 7f90ebe00640 1 -- 172.21.15.62:0/1654206295 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e002ae40 con 0x7f90ec1589e0 2024-08-17T02:27:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.140+0000 7f90ebe00640 1 -- 172.21.15.62:0/1654206295 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0032440 con 0x7f90ec1589e0 2024-08-17T02:27:09.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.140+0000 7f90ebe00640 1 -- 172.21.15.62:0/1654206295 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00327e0 con 0x7f90ec1589e0 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.140+0000 7f90f4400640 1 -- 172.21.15.62:0/1654206295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 msgr2=0x7f90ec158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.140+0000 7f90f4400640 1 --2- 172.21.15.62:0/1654206295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec158db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009910 tx=0x7f90e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.141+0000 7f90f4400640 1 -- 172.21.15.62:0/1654206295 shutdown_connections 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.141+0000 7f90f4400640 1 --2- 172.21.15.62:0/1654206295 >> v2:172.21.15.62:3300/0 conn(0x7f90ec0ca9c0 0x7f90ec0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.141+0000 7f90f4400640 1 --2- 172.21.15.62:0/1654206295 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec158db0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.141+0000 7f90f4400640 1 -- 172.21.15.62:0/1654206295 >> 172.21.15.62:0/1654206295 conn(0x7f90ec06e590 msgr2=0x7f90ec06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.141+0000 7f90f4400640 1 -- 172.21.15.62:0/1654206295 shutdown_connections 2024-08-17T02:27:09.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.141+0000 7f90f4400640 1 -- 172.21.15.62:0/1654206295 wait complete. 2024-08-17T02:27:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.142+0000 7f90f4400640 1 Processor -- start 2024-08-17T02:27:09.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.142+0000 7f90f4400640 1 -- start start 2024-08-17T02:27:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f4400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec0ca9c0 0x7f90ec14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f4400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 0x7f90ec0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f4400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f4400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b0b10 con 0x7f90ec0ca9c0 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f4400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b2b50 con 0x7f90ec0cda30 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f4400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b2e30 con 0x7f90ec1589e0 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f1000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 0x7f90ec0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec0ca9c0 0x7f90ec14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f1000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 0x7f90ec0c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50102/0 (socket says 172.21.15.62:50102) 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f1000640 1 -- 172.21.15.62:0/3370040640 learned_addr learned my addr 172.21.15.62:0/3370040640 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:09.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.143+0000 7f90f2400640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f1000640 1 -- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 msgr2=0x7f90ec157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f1000640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f1000640 1 -- 172.21.15.62:0/3370040640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec0ca9c0 msgr2=0x7f90ec14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f1000640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec0ca9c0 0x7f90ec14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f1000640 1 -- 172.21.15.62:0/3370040640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009390 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f1000640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 0x7f90ec0c6dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f90d800ec80 tx=0x7f90d80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800eec0 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d800cbc0 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8013470 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.144+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e0009450 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.145+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0b33f0 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.145+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f90d8005970 con 0x7f90ec0cda30 2024-08-17T02:27:09.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.145+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f90d8006620 con 0x7f90ec0cda30 2024-08-17T02:27:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.145+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec063fb0 con 0x7f90ec0cda30 2024-08-17T02:27:09.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.148+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f90d8021060 con 0x7f90ec0cda30 2024-08-17T02:27:09.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.223+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a4e2ad3a-18db-4267-974b-47ea6a5b67fe", "id": 6} v 0) v1 -- 0x7f90ec0c6ac0 con 0x7f90ec0cda30 2024-08-17T02:27:09.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.227+0000 7f90e8c00640 1 -- 172.21.15.62:0/3370040640 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4e2ad3a-18db-4267-974b-47ea6a5b67fe", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f90d8017070 con 0x7f90ec0cda30 2024-08-17T02:27:09.226 INFO:teuthology.orchestra.run.smithi062.stdout:6 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 msgr2=0x7f90ec0c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 0x7f90ec0c6dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f90d800ec80 tx=0x7f90d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 shutdown_connections 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90ec1589e0 0x7f90ec157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90ec0cda30 0x7f90ec0c6dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 --2- 172.21.15.62:0/3370040640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90ec0ca9c0 0x7f90ec14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 >> 172.21.15.62:0/3370040640 conn(0x7f90ec06e590 msgr2=0x7f90ec1552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 shutdown_connections 2024-08-17T02:27:09.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.228+0000 7f90f4400640 1 -- 172.21.15.62:0/3370040640 wait complete. 2024-08-17T02:27:09.240 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:09.239+0000 7f25de413ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:27:09.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 4c1c18a3-982a-4d69-9922-912a450abf79 7 2024-08-17T02:27:09.381 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:09.381+0000 7f3254917ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:27:09.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.387+0000 7f2515200640 1 Processor -- start 2024-08-17T02:27:09.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.387+0000 7f2515200640 1 -- start start 2024-08-17T02:27:09.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f2515200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f25101589e0 0x7f2510158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f2515200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100af9a0 con 0x7f25100ce140 2024-08-17T02:27:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f2515200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25100ce740 con 0x7f25100ca9c0 2024-08-17T02:27:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f2515200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25100af810 con 0x7f25101589e0 2024-08-17T02:27:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250d400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f25100ca9c0 0x7f25100cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46680/0 (socket says 172.21.15.62:46680) 2024-08-17T02:27:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250d400640 1 -- 172.21.15.62:0/2708032581 learned_addr learned my addr 172.21.15.62:0/2708032581 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-08-17T02:27:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250de00640 1 --2- 172.21.15.62:0/2708032581 >> v2:172.21.15.42:3300/0 conn(0x7f25101589e0 0x7f2510158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675707625 0 0) 0x7f25100ce740 con 0x7f25100ca9c0 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f40034e0 con 0x7f25100ca9c0 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079750540 0 0) 0x7f25100af9a0 con 0x7f25100ce140 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.389+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25100ce740 con 0x7f25100ce140 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.390+0000 7f250de00640 1 -- 172.21.15.62:0/2708032581 >> v1:172.21.15.62:6789/0 conn(0x7f25100ca9c0 legacy=0x7f25100cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.390+0000 7f250de00640 1 -- 172.21.15.62:0/2708032581 >> v1:172.21.15.42:6789/0 conn(0x7f25100ce140 legacy=0x7f25100afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.390+0000 7f250de00640 1 -- 172.21.15.62:0/2708032581 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100cea00 con 0x7f25101589e0 2024-08-17T02:27:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.391+0000 7f250de00640 1 --2- 172.21.15.62:0/2708032581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f2510158db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2500009850 tx=0x7f25000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74244fa6277efac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.391+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250002ae20 con 0x7f25101589e0 2024-08-17T02:27:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.391+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500032440 con 0x7f25101589e0 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.391+0000 7f250ca00640 1 -- 172.21.15.62:0/2708032581 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000327e0 con 0x7f25101589e0 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.391+0000 7f2515200640 1 -- 172.21.15.62:0/2708032581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 msgr2=0x7f2510158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.391+0000 7f2515200640 1 --2- 172.21.15.62:0/2708032581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f2510158db0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2500009850 tx=0x7f25000090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.392+0000 7f2515200640 1 -- 172.21.15.62:0/2708032581 shutdown_connections 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.392+0000 7f2515200640 1 --2- 172.21.15.62:0/2708032581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f2510158db0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.392+0000 7f2515200640 1 -- 172.21.15.62:0/2708032581 >> 172.21.15.62:0/2708032581 conn(0x7f251006e590 msgr2=0x7f251006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.392+0000 7f2515200640 1 -- 172.21.15.62:0/2708032581 shutdown_connections 2024-08-17T02:27:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.392+0000 7f2515200640 1 -- 172.21.15.62:0/2708032581 wait complete. 2024-08-17T02:27:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.393+0000 7f2515200640 1 Processor -- start 2024-08-17T02:27:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.393+0000 7f2515200640 1 -- start start 2024-08-17T02:27:09.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f2515200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 0x7f25100b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f2515200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25100ce140 0x7f25100b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f2515200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f251014f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f2515200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100c73d0 con 0x7f25101589e0 2024-08-17T02:27:09.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f2515200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25100c6dc0 con 0x7f25100ce140 2024-08-17T02:27:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f2515200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25100b56f0 con 0x7f25100ca9c0 2024-08-17T02:27:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f250de00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 0x7f25100b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f250d400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25100ce140 0x7f25100b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f250de00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 0x7f25100b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:40202/0 (socket says 172.21.15.62:40202) 2024-08-17T02:27:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f250de00640 1 -- 172.21.15.62:0/1271128128 learned_addr learned my addr 172.21.15.62:0/1271128128 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-08-17T02:27:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.394+0000 7f250e800640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f251014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250de00640 1 -- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25100ce140 msgr2=0x7f25100b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250de00640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25100ce140 0x7f25100b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250de00640 1 -- 172.21.15.62:0/1271128128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 msgr2=0x7f251014f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250de00640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f251014f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250de00640 1 -- 172.21.15.62:0/1271128128 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500009390 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250d400640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25100ce140 0x7f25100b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f250de00640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 0x7f25100b19d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2500009360 tx=0x7f2500032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.395+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500000c40 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.396+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500031a60 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.396+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25100b59d0 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.396+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500031e00 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.396+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251014fe50 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.396+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2500039040 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.396+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f250003ba60 con 0x7f25100ca9c0 2024-08-17T02:27:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.397+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2510063fb0 con 0x7f25100ca9c0 2024-08-17T02:27:09.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.399+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f2500042070 con 0x7f25100ca9c0 2024-08-17T02:27:09.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.474+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c1c18a3-982a-4d69-9922-912a450abf79", "id": 7} v 0) v1 -- 0x7f25100c50a0 con 0x7f25100ca9c0 2024-08-17T02:27:09.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.478+0000 7f2505600640 1 -- 172.21.15.62:0/1271128128 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c1c18a3-982a-4d69-9922-912a450abf79", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2500037070 con 0x7f25100ca9c0 2024-08-17T02:27:09.478 INFO:teuthology.orchestra.run.smithi062.stdout:7 2024-08-17T02:27:09.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 msgr2=0x7f25100b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 0x7f25100b19d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2500009360 tx=0x7f2500032000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 shutdown_connections 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25101589e0 0x7f251014f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25100ce140 0x7f25100b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 --2- 172.21.15.62:0/1271128128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f25100ca9c0 0x7f25100b19d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 >> 172.21.15.62:0/1271128128 conn(0x7f251006e590 msgr2=0x7f25100cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 shutdown_connections 2024-08-17T02:27:09.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-08-17T02:27:09.479+0000 7f2515200640 1 -- 172.21.15.62:0/1271128128 wait complete. 2024-08-17T02:27:09.493 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:27:09.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:27:09.497 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:27:09.497 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:27:09.497 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:27:09.501 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:27:09.501 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:27:09.501 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:27:09.505 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:27:09.505 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:27:09.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:27:09.510 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:27:09.510 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:27:09.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:27:09.514 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:27:09.514 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:27:09.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:27:09.518 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:27:09.519 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:27:09.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:27:09.523 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:27:09.524 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:27:09.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:27:09.525 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:09.524+0000 7f25de413ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:09.528 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:27:09.528 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:09.618 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:09.617+0000 7f25de413ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:09.711 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:09.711+0000 7f3254917ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.730+0000 7f87b7200640 1 Processor -- start 2024-08-17T02:27:09.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.730+0000 7f87b7200640 1 -- start start 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b7200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b7200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87b8159030 0x7f87b80ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b7200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b815b6b0 con 0x7f87b8159420 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b7200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b80b0540 con 0x7f87b8159030 2024-08-17T02:27:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b7200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815aac0 con 0x7f87b8158c60 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b6800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f87b8159420 0x7f87b80b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49008/0 (socket says 172.21.15.42:49008) 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b6800640 1 -- 172.21.15.42:0/3125294153 learned_addr learned my addr 172.21.15.42:0/3125294153 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:09.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b5400640 1 --2- 172.21.15.42:0/3125294153 >> v2:172.21.15.62:3300/0 conn(0x7f87b8159030 0x7f87b80ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.731+0000 7f87b5e00640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.732+0000 7f87b4a00640 1 -- 172.21.15.42:0/3125294153 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276042508 0 0) 0x7f87b815b6b0 con 0x7f87b8159420 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.732+0000 7f87b5400640 1 -- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 msgr2=0x7f87b815a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.732+0000 7f87b5400640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b815a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.732+0000 7f87b5400640 1 -- 172.21.15.42:0/3125294153 >> v1:172.21.15.42:6789/0 conn(0x7f87b8159420 legacy=0x7f87b80b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.732+0000 7f87b5400640 1 -- 172.21.15.42:0/3125294153 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b815ad80 con 0x7f87b8159030 2024-08-17T02:27:09.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.732+0000 7f87b5e00640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.733+0000 7f87b5400640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80ca8b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009850 tx=0x7f87a40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f13b8897324128d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.733+0000 7f87b4a00640 1 -- 172.21.15.42:0/3125294153 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a402ad00 con 0x7f87b8159030 2024-08-17T02:27:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.733+0000 7f87b4a00640 1 -- 172.21.15.42:0/3125294153 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a402ae60 con 0x7f87b8159030 2024-08-17T02:27:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.733+0000 7f87b4a00640 1 -- 172.21.15.42:0/3125294153 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4032670 con 0x7f87b8159030 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 -- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 msgr2=0x7f87b80ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80ca8b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009850 tx=0x7f87a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 -- 172.21.15.42:0/3125294153 shutdown_connections 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80ca8b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 --2- 172.21.15.42:0/3125294153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b815a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 -- 172.21.15.42:0/3125294153 >> 172.21.15.42:0/3125294153 conn(0x7f87b806e590 msgr2=0x7f87b806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 -- 172.21.15.42:0/3125294153 shutdown_connections 2024-08-17T02:27:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.734+0000 7f87b7200640 1 -- 172.21.15.42:0/3125294153 wait complete. 2024-08-17T02:27:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.735+0000 7f87b7200640 1 Processor -- start 2024-08-17T02:27:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 -- start start 2024-08-17T02:27:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b81520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87b8159420 0x7f87b80c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:09.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80c4b00 con 0x7f87b8159420 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8152600 con 0x7f87b8159030 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.736+0000 7f87b7200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80c3ef0 con 0x7f87b8158c60 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b81520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b81520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:57352/0 (socket says 172.21.15.42:57352) 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5e00640 1 -- 172.21.15.42:0/782875064 learned_addr learned my addr 172.21.15.42:0/782875064 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b6800640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87b8159420 0x7f87b80c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 -- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 msgr2=0x7f87b81520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b81520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 -- 172.21.15.42:0/782875064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87b8159420 msgr2=0x7f87b80c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87b8159420 0x7f87b80c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 -- 172.21.15.42:0/782875064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009390 con 0x7f87b8159030 2024-08-17T02:27:09.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5e00640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b81520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.737+0000 7f87b5400640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80c3610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f87a4031000 tx=0x7f87a4032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4031700 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4031880 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a4009390 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4031c40 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b80c44b0 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f87a4043030 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.738+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f87a4041070 con 0x7f87b8159030 2024-08-17T02:27:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.739+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b8070720 con 0x7f87b8159030 2024-08-17T02:27:09.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.742+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f87a40657a0 con 0x7f87b8159030 2024-08-17T02:27:09.763 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:09.762+0000 7f25de413ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:27:09.774 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:09.773+0000 7f3254917ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:09.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.806+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87b80b4f00 con 0x7f87b8159030 2024-08-17T02:27:09.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.807+0000 7f87ad600640 1 -- 172.21.15.42:0/782875064 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f87a4054070 con 0x7f87b8159030 2024-08-17T02:27:09.808 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:09.808 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:09.476205+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 msgr2=0x7f87b80c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80c3610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f87a4031000 tx=0x7f87a4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 shutdown_connections 2024-08-17T02:27:09.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87b8159420 0x7f87b80c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87b8159030 0x7f87b80c3610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 --2- 172.21.15.42:0/782875064 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87b8158c60 0x7f87b81520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 >> 172.21.15.42:0/782875064 conn(0x7f87b806e590 msgr2=0x7f87b80b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 shutdown_connections 2024-08-17T02:27:09.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:09.808+0000 7f87b7200640 1 -- 172.21.15.42:0/782875064 wait complete. 2024-08-17T02:27:09.824 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:27:09.824 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:27:09.889 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:09.888+0000 7f3254917ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:27:10.064 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:10.063+0000 7f25de413ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:10.119 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:10.118+0000 7f25de413ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:10.183 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-08-17T02:27:10.182+0000 7fb40263e2c0 -1 Falling back to public interface 2024-08-17T02:27:10.185 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:10.184+0000 7f3254917ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:10.185 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-08-17T02:27:10.185+0000 7f1415c0e2c0 -1 Falling back to public interface 2024-08-17T02:27:10.194 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-08-17T02:27:10.194+0000 7fd3a20152c0 -1 Falling back to public interface 2024-08-17T02:27:10.196 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-08-17T02:27:10.195+0000 7f34b048d2c0 -1 Falling back to public interface 2024-08-17T02:27:10.206 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-08-17T02:27:10.205+0000 7f2662f532c0 -1 Falling back to public interface 2024-08-17T02:27:10.211 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-08-17T02:27:10.210+0000 7f76161282c0 -1 Falling back to public interface 2024-08-17T02:27:10.219 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-08-17T02:27:10.219+0000 7f2e2240a2c0 -1 Falling back to public interface 2024-08-17T02:27:10.220 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-08-17T02:27:10.218+0000 7fd228a492c0 -1 Falling back to public interface 2024-08-17T02:27:10.243 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:10.243+0000 7f3254917ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:10.310 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:10.307+0000 7f25de413ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:10.367 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:10.365+0000 7f25de413ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:10.429 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:10.428+0000 7f3254917ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:10.449 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:10.448+0000 7f25de413ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:10.488 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:10.488+0000 7f3254917ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:10.502 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:10.501+0000 7f25de413ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:10.571 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:10.571+0000 7f3254917ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:10.625 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:10.624+0000 7f3254917ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:10.629 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:10.762 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.760+0000 7f564da00640 1 Processor -- start 2024-08-17T02:27:10.762 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.760+0000 7f564da00640 1 -- start start 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.761+0000 7f564da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5648158db0 0x7f56480caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.761+0000 7f564da00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f56480d0030 0x7f56480d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.761+0000 7f564da00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480af2c0 con 0x7f5648159180 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.761+0000 7f564da00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56480d09a0 con 0x7f56480d0030 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.761+0000 7f564da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480b0410 con 0x7f5648158db0 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5647400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f56480d0030 0x7f56480d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.763 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5646a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5648158db0 0x7f56480caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.764 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5646000640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5648159180 0x7f56480af8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:60104/0 (socket says 172.21.15.42:60104) 2024-08-17T02:27:10.764 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5646000640 1 -- 172.21.15.42:0/3819792692 learned_addr learned my addr 172.21.15.42:0/3819792692 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:10.765 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5647400640 1 -- 172.21.15.42:0/3819792692 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5648158db0 msgr2=0x7f56480caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:10.765 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5647400640 1 --2- 172.21.15.42:0/3819792692 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5648158db0 0x7f56480caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.766 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5647400640 1 -- 172.21.15.42:0/3819792692 >> v1:172.21.15.62:6789/0 conn(0x7f5648159180 legacy=0x7f56480af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.766 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5647400640 1 -- 172.21.15.42:0/3819792692 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480b3c60 con 0x7f56480d0030 2024-08-17T02:27:10.766 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.762+0000 7f5645600640 1 -- 172.21.15.42:0/3819792692 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330272981 0 0) 0x7f56480af2c0 con 0x7f5648159180 2024-08-17T02:27:10.766 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.763+0000 7f5647400640 1 --2- 172.21.15.42:0/3819792692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56480d0030 0x7f56480d0460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5640009e60 tx=0x7f5640009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a179cef4821fa300 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.766 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.763+0000 7f5645600640 1 -- 172.21.15.42:0/3819792692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640007550 con 0x7f56480d0030 2024-08-17T02:27:10.766 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.763+0000 7f5645600640 1 -- 172.21.15.42:0/3819792692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564002d050 con 0x7f56480d0030 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.763+0000 7f5645600640 1 -- 172.21.15.42:0/3819792692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400078e0 con 0x7f56480d0030 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 -- 172.21.15.42:0/3819792692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56480d0030 msgr2=0x7f56480d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 --2- 172.21.15.42:0/3819792692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56480d0030 0x7f56480d0460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5640009e60 tx=0x7f5640009780 comp rx=0 tx=0).stop 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 -- 172.21.15.42:0/3819792692 shutdown_connections 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 --2- 172.21.15.42:0/3819792692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56480d0030 0x7f56480d0460 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 --2- 172.21.15.42:0/3819792692 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5648158db0 0x7f56480caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 -- 172.21.15.42:0/3819792692 >> 172.21.15.42:0/3819792692 conn(0x7f5648062bf0 msgr2=0x7f5648062ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 -- 172.21.15.42:0/3819792692 shutdown_connections 2024-08-17T02:27:10.767 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.764+0000 7f564da00640 1 -- 172.21.15.42:0/3819792692 wait complete. 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.766+0000 7f564da00640 1 Processor -- start 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.766+0000 7f564da00640 1 -- start start 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f564da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56480d0030 0x7f5648147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f564da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 0x7f564815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f564da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5648159180 0x7f564815da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f564da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564815a4a0 con 0x7f5648158db0 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f564da00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564815a780 con 0x7f5648159180 2024-08-17T02:27:10.770 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f564da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564815aa60 con 0x7f56480d0030 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 0x7f564815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 0x7f564815bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58652/0 (socket says 172.21.15.42:58652) 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 -- 172.21.15.42:0/3151767410 learned_addr learned my addr 172.21.15.42:0/3151767410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646a00640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56480d0030 0x7f5648147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5647400640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5648159180 0x7f564815da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 -- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56480d0030 msgr2=0x7f5648147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56480d0030 0x7f5648147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 -- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5648159180 msgr2=0x7f564815da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5648159180 0x7f564815da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.767+0000 7f5646000640 1 -- 172.21.15.42:0/3151767410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009a20 con 0x7f5648158db0 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f5646000640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 0x7f564815bb30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f563400c5e0 tx=0x7f5634007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:10.771 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634005aa0 con 0x7f5648158db0 2024-08-17T02:27:10.772 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634005c00 con 0x7f5648158db0 2024-08-17T02:27:10.772 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340070f0 con 0x7f5648158db0 2024-08-17T02:27:10.772 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564815ad40 con 0x7f5648158db0 2024-08-17T02:27:10.772 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481475a0 con 0x7f5648158db0 2024-08-17T02:27:10.772 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f56340074e0 con 0x7f5648158db0 2024-08-17T02:27:10.772 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.768+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f563401b400 con 0x7f5648158db0 2024-08-17T02:27:10.773 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.769+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5648064540 con 0x7f5648158db0 2024-08-17T02:27:10.773 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.772+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5634025480 con 0x7f5648158db0 2024-08-17T02:27:10.838 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.837+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56480b4630 con 0x7f5648158db0 2024-08-17T02:27:10.839 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.838+0000 7f563e000640 1 -- 172.21.15.42:0/3151767410 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5634012400 con 0x7f5648158db0 2024-08-17T02:27:10.839 INFO:teuthology.misc.health.smithi042.stdout: 2024-08-17T02:27:10.839 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":10,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:09.476205+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:10.840 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 msgr2=0x7f564815bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:10.840 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 0x7f564815bb30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f563400c5e0 tx=0x7f5634007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 shutdown_connections 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5648159180 0x7f564815da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5648158db0 0x7f564815bb30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 --2- 172.21.15.42:0/3151767410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56480d0030 0x7f5648147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 >> 172.21.15.42:0/3151767410 conn(0x7f5648062bf0 msgr2=0x7f56480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 shutdown_connections 2024-08-17T02:27:10.841 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:10.839+0000 7f564da00640 1 -- 172.21.15.42:0/3151767410 wait complete. 2024-08-17T02:27:10.852 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:27:11.054 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:11.052+0000 7f25de413ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:11.167 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:11.166+0000 7f25de413ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:11.171 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:11.170+0000 7f3254917ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:11.288 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-08-17T02:27:11.288+0000 7f3254917ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:12.188 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:12.187+0000 7f25c2a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:27:12.189 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-08-17T02:27:12.187+0000 7f25c2a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:27:13.760 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-08-17T02:27:13.760+0000 7f1415c0e2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:27:13.814 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-08-17T02:27:13.813+0000 7f34b048d2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:27:13.817 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-08-17T02:27:13.816+0000 7fd228a492c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:27:13.817 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-08-17T02:27:13.816+0000 7f2662f532c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:27:13.817 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-08-17T02:27:13.817+0000 7fd3a20152c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:27:13.820 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-08-17T02:27:13.819+0000 7f76161282c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:27:13.835 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-08-17T02:27:13.833+0000 7fb40263e2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:27:13.836 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-08-17T02:27:13.835+0000 7f2e2240a2c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:27:16.911 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-08-17T02:27:16.909+0000 7f265c600640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:27:16.915 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-08-17T02:27:16.914+0000 7f34aa200640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:27:16.920 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-08-17T02:27:16.919+0000 7f2653a00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:16.924 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-08-17T02:27:16.923+0000 7f34a1600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:16.972 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-08-17T02:27:16.971+0000 7fb3fd800640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:27:16.974 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-08-17T02:27:16.973+0000 7fd221e00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:27:16.978 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-08-17T02:27:16.977+0000 7fb3f2e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:16.979 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-08-17T02:27:16.978+0000 7fd219200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:17.440 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-08-17T02:27:17.438+0000 7fd39d200640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:27:17.446 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-08-17T02:27:17.446+0000 7fd392800640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:17.480 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-08-17T02:27:17.479+0000 7f760f800640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:27:17.486 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-08-17T02:27:17.485+0000 7f7606c00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:17.559 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-08-17T02:27:17.559+0000 7f2e1b800640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:27:17.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-08-17T02:27:17.565+0000 7f2e12c00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:17.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-08-17T02:27:17.568+0000 7f140f000640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:27:17.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-08-17T02:27:17.573+0000 7f1406400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:17.658 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:17.795 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.794+0000 7fade5600640 1 Processor -- start 2024-08-17T02:27:17.795 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.794+0000 7fade5600640 1 -- start start 2024-08-17T02:27:17.796 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7fade5600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b4a80 0x7fade0159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.796 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7fade5600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fade00689d0 0x7fade00b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.796 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7fade5600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade00cf380 con 0x7fade00b46b0 2024-08-17T02:27:17.797 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7fade5600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade00cf810 con 0x7fade00689d0 2024-08-17T02:27:17.797 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7fade5600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade015a480 con 0x7fade00b4a80 2024-08-17T02:27:17.797 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7faddea00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fade00b46b0 0x7fade00682c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45166/0 (socket says 172.21.15.42:45166) 2024-08-17T02:27:17.797 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.795+0000 7faddea00640 1 -- 172.21.15.42:0/855521935 learned_addr learned my addr 172.21.15.42:0/855521935 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:17.797 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddf400640 1 --2- 172.21.15.42:0/855521935 >> v2:172.21.15.62:3300/0 conn(0x7fade00689d0 0x7fade00b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7fadde000640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b4a80 0x7fade0159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddd600640 1 -- 172.21.15.42:0/855521935 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880625346 0 0) 0x7fade00cf380 con 0x7fade00b46b0 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddd600640 1 -- 172.21.15.42:0/855521935 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc40034e0 con 0x7fade00b46b0 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddf400640 1 -- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b4a80 msgr2=0x7fade0159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddf400640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b4a80 0x7fade0159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddf400640 1 -- 172.21.15.42:0/855521935 >> v1:172.21.15.42:6789/0 conn(0x7fade00b46b0 legacy=0x7fade00682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7faddf400640 1 -- 172.21.15.42:0/855521935 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00ce770 con 0x7fade00689d0 2024-08-17T02:27:17.798 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.796+0000 7fadde000640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b4a80 0x7fade0159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:17.799 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.797+0000 7faddf400640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00689d0 0x7fade00b2b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e60 tx=0x7fadd8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4951a75dfb1001 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.799 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.797+0000 7faddd600640 1 -- 172.21.15.42:0/855521935 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8007550 con 0x7fade00689d0 2024-08-17T02:27:17.799 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.797+0000 7faddd600640 1 -- 172.21.15.42:0/855521935 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd802d050 con 0x7fade00689d0 2024-08-17T02:27:17.799 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.797+0000 7faddd600640 1 -- 172.21.15.42:0/855521935 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8007920 con 0x7fade00689d0 2024-08-17T02:27:17.799 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 -- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00689d0 msgr2=0x7fade00b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00689d0 0x7fade00b2b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e60 tx=0x7fadd8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 -- 172.21.15.42:0/855521935 shutdown_connections 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00689d0 0x7fade00b2b00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 --2- 172.21.15.42:0/855521935 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b4a80 0x7fade0159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 -- 172.21.15.42:0/855521935 >> 172.21.15.42:0/855521935 conn(0x7fade006ef60 msgr2=0x7fade00b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 -- 172.21.15.42:0/855521935 shutdown_connections 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.798+0000 7fade5600640 1 -- 172.21.15.42:0/855521935 wait complete. 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.799+0000 7fade5600640 1 Processor -- start 2024-08-17T02:27:17.800 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.799+0000 7fade5600640 1 -- start start 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7fade5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 0x7fade00b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7fade5600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b46b0 0x7fade00c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7fade5600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00b4a80 0x7fade00c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7fade5600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01457e0 con 0x7fade00689d0 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7fade5600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade00c5a80 con 0x7fade00b4a80 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7fade5600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00c5d60 con 0x7fade00b46b0 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.800+0000 7faddea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 0x7fade00b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 0x7fade00b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40446/0 (socket says 172.21.15.42:40446) 2024-08-17T02:27:17.802 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 -- 172.21.15.42:0/1256252061 learned_addr learned my addr 172.21.15.42:0/1256252061 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:17.803 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7fadde000640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b46b0 0x7fade00c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.803 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddf400640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00b4a80 0x7fade00c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 -- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b46b0 msgr2=0x7fade00c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b46b0 0x7fade00c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 -- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00b4a80 msgr2=0x7fade00c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00b4a80 0x7fade00c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 -- 172.21.15.42:0/1256252061 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009390 con 0x7fade00689d0 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7faddea00640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 0x7fade00b0ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fadd000c5b0 tx=0x7fadd0007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.801+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0005b70 con 0x7fade00689d0 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.802+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd0005cf0 con 0x7fade00689d0 2024-08-17T02:27:17.804 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.802+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0007340 con 0x7fade00689d0 2024-08-17T02:27:17.805 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.802+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd8009a20 con 0x7fade00689d0 2024-08-17T02:27:17.805 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.802+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade0145470 con 0x7fade00689d0 2024-08-17T02:27:17.805 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.803+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade0064540 con 0x7fade00689d0 2024-08-17T02:27:17.805 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.803+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fadd001b400 con 0x7fade00689d0 2024-08-17T02:27:17.806 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.804+0000 7fadd6000640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadc00650c0 0x7fadc0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:17.806 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.804+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fadd0080ff0 con 0x7fade00689d0 2024-08-17T02:27:17.806 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.805+0000 7fadde000640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadc00650c0 0x7fadc0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:17.806 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.805+0000 7fadde000640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadc00650c0 0x7fadc0067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fade015c730 tx=0x7fadcc0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:17.810 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:17.809+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fadd004fff0 con 0x7fade00689d0 2024-08-17T02:27:18.006 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.005+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fade00c57c0 con 0x7fade00689d0 2024-08-17T02:27:18.007 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.006+0000 7fadd6000640 1 -- 172.21.15.42:0/1256252061 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7fadd0053610 con 0x7fade00689d0 2024-08-17T02:27:18.007 INFO:teuthology.misc.health.smithi042.stdout: 2024-08-17T02:27:18.008 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":13,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:17.915482+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadc00650c0 msgr2=0x7fadc0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadc00650c0 0x7fadc0067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fade015c730 tx=0x7fadcc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 msgr2=0x7fade00b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 0x7fade00b0ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fadd000c5b0 tx=0x7fadd0007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 shutdown_connections 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadc00650c0 0x7fadc0067570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade00b4a80 0x7fade00c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade00b46b0 0x7fade00c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 --2- 172.21.15.42:0/1256252061 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fade00689d0 0x7fade00b0ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 >> 172.21.15.42:0/1256252061 conn(0x7fade006ef60 msgr2=0x7fade00682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.010 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 shutdown_connections 2024-08-17T02:27:18.011 INFO:teuthology.misc.health.smithi042.stderr:2024-08-17T02:27:18.008+0000 7fade5600640 1 -- 172.21.15.42:0/1256252061 wait complete. 2024-08-17T02:27:18.022 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:27:18.022 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:27:18.023 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:27:18.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:27:18.026 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:27:18.027 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:27:18.027 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:27:18.030 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:27:18.030 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:27:18.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:27:18.035 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:27:18.035 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:27:18.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:27:18.038 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:27:18.038 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:27:18.039 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:18.151 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-08-17T02:27:18.154 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-08-17T02:27:18.159 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-08-17T02:27:18.161 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-08-17T02:27:18.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.197+0000 7f63c5400640 1 Processor -- start 2024-08-17T02:27:18.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.197+0000 7f63c5400640 1 -- start start 2024-08-17T02:27:18.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.198+0000 7f63c5400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63c0159120 0x7f63c00ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.198+0000 7f63c5400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c00aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.198+0000 7f63c5400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00a96c0 con 0x7f63c0158d50 2024-08-17T02:27:18.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.198+0000 7f63c5400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c00ac270 con 0x7f63c0159120 2024-08-17T02:27:18.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.198+0000 7f63c5400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00acf00 con 0x7f63c00abe30 2024-08-17T02:27:18.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bde00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f63c0159120 0x7f63c00ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bf200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c00aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63be800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f63c0158d50 0x7f63c00ac4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:47510/0 (socket says 172.21.15.42:47510) 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63be800640 1 -- 172.21.15.42:0/2972577562 learned_addr learned my addr 172.21.15.42:0/2972577562 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bde00640 1 -- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 msgr2=0x7f63c00aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bde00640 1 --2- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c00aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bde00640 1 -- 172.21.15.42:0/2972577562 >> v1:172.21.15.62:6789/0 conn(0x7f63c0158d50 legacy=0x7f63c00ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bde00640 1 -- 172.21.15.42:0/2972577562 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00af7d0 con 0x7f63c0159120 2024-08-17T02:27:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.199+0000 7f63bd400640 1 -- 172.21.15.42:0/2972577562 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781320137 0 0) 0x7f63c00a96c0 con 0x7f63c0158d50 2024-08-17T02:27:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.200+0000 7f63bde00640 1 --2- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0159120 0x7f63c00ab8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009850 tx=0x7f63ac0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78446114c17392ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.200+0000 7f63bd400640 1 -- 172.21.15.42:0/2972577562 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac02ad00 con 0x7f63c0159120 2024-08-17T02:27:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.200+0000 7f63bd400640 1 -- 172.21.15.42:0/2972577562 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac02ae60 con 0x7f63c0159120 2024-08-17T02:27:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.200+0000 7f63bd400640 1 -- 172.21.15.42:0/2972577562 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac032670 con 0x7f63c0159120 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 -- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0159120 msgr2=0x7f63c00ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 --2- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0159120 0x7f63c00ab8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009850 tx=0x7f63ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 -- 172.21.15.42:0/2972577562 shutdown_connections 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 --2- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c00aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 --2- 172.21.15.42:0/2972577562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0159120 0x7f63c00ab8f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 -- 172.21.15.42:0/2972577562 >> 172.21.15.42:0/2972577562 conn(0x7f63c0095a70 msgr2=0x7f63c0095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 -- 172.21.15.42:0/2972577562 shutdown_connections 2024-08-17T02:27:18.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.201+0000 7f63c5400640 1 -- 172.21.15.42:0/2972577562 wait complete. 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.202+0000 7f63c5400640 1 Processor -- start 2024-08-17T02:27:18.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.202+0000 7f63c5400640 1 -- start start 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.203+0000 7f63c5400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c01421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.203+0000 7f63c5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0158d50 0x7f63c0142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.203+0000 7f63c5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 0x7f63c0142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.203+0000 7f63c5400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0099e10 con 0x7f63c0159120 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.203+0000 7f63c5400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c009a0f0 con 0x7f63c0158d50 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.203+0000 7f63c5400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c009a3d0 con 0x7f63c00abe30 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 0x7f63c0142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63be800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c01421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 0x7f63c0142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40474/0 (socket says 172.21.15.42:40474) 2024-08-17T02:27:18.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 -- 172.21.15.42:0/2471016084 learned_addr learned my addr 172.21.15.42:0/2471016084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:18.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bde00640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0158d50 0x7f63c0142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 -- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 msgr2=0x7f63c01421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c01421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 -- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0158d50 msgr2=0x7f63c0142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0158d50 0x7f63c0142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 -- 172.21.15.42:0/2471016084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac009390 con 0x7f63c0159120 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63bf200640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 0x7f63c0142c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009df0 tx=0x7f63b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.204+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800cd40 con 0x7f63c0159120 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.205+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800f040 con 0x7f63c0159120 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.205+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b80146d0 con 0x7f63c0159120 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.205+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c009a6b0 con 0x7f63c0159120 2024-08-17T02:27:18.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.205+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0143180 con 0x7f63c0159120 2024-08-17T02:27:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.206+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c0141ec0 con 0x7f63c0159120 2024-08-17T02:27:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.207+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f63b8014a80 con 0x7f63c0159120 2024-08-17T02:27:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.207+0000 7f63b6000640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f63a00650c0 0x7f63a0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.207+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f63b8082860 con 0x7f63c0159120 2024-08-17T02:27:18.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.208+0000 7f63be800640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f63a00650c0 0x7f63a0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.209+0000 7f63be800640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f63a00650c0 0x7f63a0067570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63c016cc70 tx=0x7f63b0007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.213+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63b8050ee0 con 0x7f63c0159120 2024-08-17T02:27:18.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.396+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63c0099f50 con 0x7f63c0159120 2024-08-17T02:27:18.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.396+0000 7f63b6000640 1 -- 172.21.15.42:0/2471016084 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7f63c0099f50 con 0x7f63c0159120 2024-08-17T02:27:18.398 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:18.398 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":13,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:17.915482+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f63a00650c0 msgr2=0x7f63a0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f63a00650c0 0x7f63a0067570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63c016cc70 tx=0x7f63b0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 msgr2=0x7f63c0142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 0x7f63c0142c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63b8009df0 tx=0x7f63b800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 shutdown_connections 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f63a00650c0 0x7f63a0067570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63c0159120 0x7f63c0142c40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f63c0158d50 0x7f63c0142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 --2- 172.21.15.42:0/2471016084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f63c00abe30 0x7f63c01421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.398+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 >> 172.21.15.42:0/2471016084 conn(0x7f63c0095a70 msgr2=0x7f63c0152530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.399+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 shutdown_connections 2024-08-17T02:27:18.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.399+0000 7f63c5400640 1 -- 172.21.15.42:0/2471016084 wait complete. 2024-08-17T02:27:18.414 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:27:18.415 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:18.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.565+0000 7f4d68200640 1 Processor -- start 2024-08-17T02:27:18.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.565+0000 7f4d68200640 1 -- start start 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d68200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4d60158b90 0x7f4d600b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d68200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d600aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d68200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600af380 con 0x7f4d600aef60 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d68200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600afd20 con 0x7f4d60158b90 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d68200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600affe0 con 0x7f4d600b2370 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d66200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4d600aef60 0x7f4d60068630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:45182/0 (socket says 172.21.15.42:45182) 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.566+0000 7f4d66200640 1 -- 172.21.15.42:0/819877634 learned_addr learned my addr 172.21.15.42:0/819877634 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d64e00640 1 --2- 172.21.15.42:0/819877634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d600aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d65800640 1 --2- 172.21.15.42:0/819877634 >> v2:172.21.15.62:3300/0 conn(0x7f4d60158b90 0x7f4d600b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d64e00640 1 -- 172.21.15.42:0/819877634 >> v2:172.21.15.62:3300/0 conn(0x7f4d60158b90 msgr2=0x7f4d600b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:18.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d64e00640 1 --2- 172.21.15.42:0/819877634 >> v2:172.21.15.62:3300/0 conn(0x7f4d60158b90 0x7f4d600b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d5fe00640 1 -- 172.21.15.42:0/819877634 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138298424 0 0) 0x7f4d600af380 con 0x7f4d600aef60 2024-08-17T02:27:18.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d64e00640 1 -- 172.21.15.42:0/819877634 >> v1:172.21.15.42:6789/0 conn(0x7f4d600aef60 legacy=0x7f4d60068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.567+0000 7f4d64e00640 1 -- 172.21.15.42:0/819877634 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600b02c0 con 0x7f4d600b2370 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.568+0000 7f4d64e00640 1 --2- 172.21.15.42:0/819877634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d600aea20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009850 tx=0x7f4d4c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33a234abedd7f5fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.568+0000 7f4d5fe00640 1 -- 172.21.15.42:0/819877634 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c02ad90 con 0x7f4d600b2370 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.568+0000 7f4d5fe00640 1 -- 172.21.15.42:0/819877634 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c032440 con 0x7f4d600b2370 2024-08-17T02:27:18.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.568+0000 7f4d5fe00640 1 -- 172.21.15.42:0/819877634 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0327e0 con 0x7f4d600b2370 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 -- 172.21.15.42:0/819877634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 msgr2=0x7f4d600aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 --2- 172.21.15.42:0/819877634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d600aea20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009850 tx=0x7f4d4c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 -- 172.21.15.42:0/819877634 shutdown_connections 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 --2- 172.21.15.42:0/819877634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d600aea20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 --2- 172.21.15.42:0/819877634 >> v2:172.21.15.62:3300/0 conn(0x7f4d60158b90 0x7f4d600b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 -- 172.21.15.42:0/819877634 >> 172.21.15.42:0/819877634 conn(0x7f4d6006e590 msgr2=0x7f4d6006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 -- 172.21.15.42:0/819877634 shutdown_connections 2024-08-17T02:27:18.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.569+0000 7f4d68200640 1 -- 172.21.15.42:0/819877634 wait complete. 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.570+0000 7f4d68200640 1 Processor -- start 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.570+0000 7f4d68200640 1 -- start start 2024-08-17T02:27:18.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d68200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 0x7f4d6016a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d68200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d6015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d68200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d60158b90 0x7f4d600ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d68200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60159930 con 0x7f4d600aef60 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d68200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6016a910 con 0x7f4d60158b90 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d68200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60159000 con 0x7f4d600b2370 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.571+0000 7f4d65800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 0x7f4d6016a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 0x7f4d6016a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40478/0 (socket says 172.21.15.42:40478) 2024-08-17T02:27:18.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 -- 172.21.15.42:0/2144527928 learned_addr learned my addr 172.21.15.42:0/2144527928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:18.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d64e00640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d6015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d66200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d60158b90 0x7f4d600ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 -- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 msgr2=0x7f4d6015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d6015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 -- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d60158b90 msgr2=0x7f4d600ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d60158b90 0x7f4d600ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 -- 172.21.15.42:0/2144527928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009390 con 0x7f4d600aef60 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d64e00640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d6015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d65800640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 0x7f4d6016a3d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400ea20 tx=0x7f4d540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400ca10 con 0x7f4d600aef60 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400cb70 con 0x7f4d600aef60 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d601592e0 con 0x7f4d600aef60 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.572+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54013470 con 0x7f4d600aef60 2024-08-17T02:27:18.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.573+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6015c570 con 0x7f4d600aef60 2024-08-17T02:27:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.574+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d60063fb0 con 0x7f4d600aef60 2024-08-17T02:27:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.574+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f4d54013860 con 0x7f4d600aef60 2024-08-17T02:27:18.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.575+0000 7f4d5cc00640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4d400650c0 0x7f4d40067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.575+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f4d54082200 con 0x7f4d600aef60 2024-08-17T02:27:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.575+0000 7f4d64e00640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4d400650c0 0x7f4d40067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:18.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.576+0000 7f4d64e00640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4d400650c0 0x7f4d40067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c034000 tx=0x7f4d4c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:18.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.579+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4d540507d0 con 0x7f4d600aef60 2024-08-17T02:27:18.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.799+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d600c6630 con 0x7f4d600aef60 2024-08-17T02:27:18.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.799+0000 7f4d5cc00640 1 -- 172.21.15.42:0/2144527928 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f4d54053df0 con 0x7f4d600aef60 2024-08-17T02:27:18.801 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:18.801 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:27:18.801 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 2 2024-08-17T02:27:18.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4d400650c0 msgr2=0x7f4d40067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4d400650c0 0x7f4d40067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c034000 tx=0x7f4d4c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:18.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 msgr2=0x7f4d6016a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 0x7f4d6016a3d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400ea20 tx=0x7f4d540090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 shutdown_connections 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4d400650c0 0x7f4d40067570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d60158b90 0x7f4d600ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d600b2370 0x7f4d6015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 --2- 172.21.15.42:0/2144527928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d600aef60 0x7f4d6016a3d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 >> 172.21.15.42:0/2144527928 conn(0x7f4d6006e590 msgr2=0x7f4d600cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 shutdown_connections 2024-08-17T02:27:18.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:18.802+0000 7f4d68200640 1 -- 172.21.15.42:0/2144527928 wait complete. 2024-08-17T02:27:19.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:19.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:20.818 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.979+0000 7f2dd6800640 1 Processor -- start 2024-08-17T02:27:20.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.979+0000 7f2dd6800640 1 -- start start 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.980+0000 7f2dd6800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2dd0158c60 0x7f2dd00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.980+0000 7f2dd6800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00b2ae0 con 0x7f2dd00cc450 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.980+0000 7f2dd6800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00b2dc0 con 0x7f2dd0159030 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.980+0000 7f2dd6800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd00cca80 con 0x7f2dd0158c60 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcfe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2dd00cc450 0x7f2dd00b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37298/0 (socket says 172.21.15.42:37298) 2024-08-17T02:27:20.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcfe00640 1 -- 172.21.15.42:0/828818882 learned_addr learned my addr 172.21.15.42:0/828818882 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcf400640 1 --2- 172.21.15.42:0/828818882 >> v2:172.21.15.62:3300/0 conn(0x7f2dd0158c60 0x7f2dd00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246005212 0 0) 0x7f2dd00b2ae0 con 0x7f2dd00cc450 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db40034e0 con 0x7f2dd00cc450 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289409468 0 0) 0x7f2dd00b2dc0 con 0x7f2dd0159030 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd00b2ae0 con 0x7f2dd0159030 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcf400640 1 -- 172.21.15.42:0/828818882 >> v1:172.21.15.62:6789/0 conn(0x7f2dd0159030 legacy=0x7f2dd00cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcf400640 1 -- 172.21.15.42:0/828818882 >> v1:172.21.15.42:6789/0 conn(0x7f2dd00cc450 legacy=0x7f2dd00b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.981+0000 7f2dcf400640 1 -- 172.21.15.42:0/828818882 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00ccd60 con 0x7f2dd0158c60 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.982+0000 7f2dcf400640 1 --2- 172.21.15.42:0/828818882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00b1b70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009850 tx=0x7f2dc00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd255ca76b39e1d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc002ad90 con 0x7f2dd0158c60 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0032440 con 0x7f2dd0158c60 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dcea00640 1 -- 172.21.15.42:0/828818882 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00327e0 con 0x7f2dd0158c60 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 -- 172.21.15.42:0/828818882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 msgr2=0x7f2dd00b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 --2- 172.21.15.42:0/828818882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00b1b70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009850 tx=0x7f2dc00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 -- 172.21.15.42:0/828818882 shutdown_connections 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 --2- 172.21.15.42:0/828818882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00b1b70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 -- 172.21.15.42:0/828818882 >> 172.21.15.42:0/828818882 conn(0x7f2dd006e590 msgr2=0x7f2dd006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 -- 172.21.15.42:0/828818882 shutdown_connections 2024-08-17T02:27:20.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.983+0000 7f2dd6800640 1 -- 172.21.15.42:0/828818882 wait complete. 2024-08-17T02:27:20.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.985+0000 7f2dd6800640 1 Processor -- start 2024-08-17T02:27:20.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.985+0000 7f2dd6800640 1 -- start start 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dd6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 0x7f2dd00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dd6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dd6800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dd0159030 0x7f2dd0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dd6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00c9e10 con 0x7f2dd00cc450 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dd6800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd016d070 con 0x7f2dd0158c60 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dd6800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00c9b30 con 0x7f2dd0159030 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 0x7f2dd00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 0x7f2dd00c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47692/0 (socket says 172.21.15.42:47692) 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 -- 172.21.15.42:0/3857874309 learned_addr learned my addr 172.21.15.42:0/3857874309 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dc7e00640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcfe00640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dd0159030 0x7f2dd0156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 -- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dd0159030 msgr2=0x7f2dd0156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dd0159030 0x7f2dd0156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 -- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 msgr2=0x7f2dd00afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.986+0000 7f2dcf400640 1 -- 172.21.15.42:0/3857874309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009390 con 0x7f2dd00cc450 2024-08-17T02:27:20.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.987+0000 7f2dcf400640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 0x7f2dd00c9270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009360 tx=0x7f2dc0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.987+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0000c40 con 0x7f2dd00cc450 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.987+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0031a60 con 0x7f2dd00cc450 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.987+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd016ca20 con 0x7f2dd00cc450 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.987+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0031e20 con 0x7f2dd00cc450 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.987+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd00c97b0 con 0x7f2dd00cc450 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.988+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd0063fb0 con 0x7f2dd00cc450 2024-08-17T02:27:20.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.989+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f2dc0039040 con 0x7f2dd00cc450 2024-08-17T02:27:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.990+0000 7f2dc6a00640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2dac0650c0 0x7f2dac067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.990+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f2dc00a1d30 con 0x7f2dd00cc450 2024-08-17T02:27:20.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.990+0000 7f2dc7e00640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2dac0650c0 0x7f2dac067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.991+0000 7f2dc7e00640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2dac0650c0 0x7f2dac067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0153bf0 tx=0x7f2db8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:20.995+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2dc0070190 con 0x7f2dd00cc450 2024-08-17T02:27:21.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.218+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dd00cfa50 con 0x7f2dd00cc450 2024-08-17T02:27:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.218+0000 7f2dc6a00640 1 -- 172.21.15.42:0/3857874309 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f2dc0037de0 con 0x7f2dd00cc450 2024-08-17T02:27:21.220 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:21.220 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:27:21.221 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-08-17T02:27:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.220+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2dac0650c0 msgr2=0x7f2dac067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.220+0000 7f2dd6800640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2dac0650c0 0x7f2dac067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0153bf0 tx=0x7f2db8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.220+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 msgr2=0x7f2dd00c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.220+0000 7f2dd6800640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 0x7f2dd00c9270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009360 tx=0x7f2dc0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:21.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 shutdown_connections 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2dac0650c0 0x7f2dac067570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dd0159030 0x7f2dd0156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dd0158c60 0x7f2dd00afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 --2- 172.21.15.42:0/3857874309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd00cc450 0x7f2dd00c9270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 >> 172.21.15.42:0/3857874309 conn(0x7f2dd006e590 msgr2=0x7f2dd00cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 shutdown_connections 2024-08-17T02:27:21.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.221+0000 7f2dd6800640 1 -- 172.21.15.42:0/3857874309 wait complete. 2024-08-17T02:27:21.236 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.387+0000 7f3bffe00640 1 Processor -- start 2024-08-17T02:27:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.387+0000 7f3bffe00640 1 -- start start 2024-08-17T02:27:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.388+0000 7f3bffe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3c0015a490 0x7f3c000ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c000b1920 0x7f3c000b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bffe00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0015b6b0 con 0x7f3c00158c60 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bffe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000b0540 con 0x7f3c0015a490 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bffe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015a8b0 con 0x7f3c000b1920 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3c0015a490 0x7f3c000ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3c0015a490 0x7f3c000ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47694/0 (socket says 172.21.15.42:47694) 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 -- 172.21.15.42:0/1692027695 learned_addr learned my addr 172.21.15.42:0/1692027695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bff400640 1 --2- 172.21.15.42:0/1692027695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c000b1920 0x7f3c000b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 -- 172.21.15.42:0/1692027695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c000b1920 msgr2=0x7f3c000b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 --2- 172.21.15.42:0/1692027695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c000b1920 0x7f3c000b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 -- 172.21.15.42:0/1692027695 >> v1:172.21.15.62:6789/0 conn(0x7f3c00158c60 legacy=0x7f3c00159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.389+0000 7f3bf7e00640 1 -- 172.21.15.42:0/1692027695 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0015aac0 con 0x7f3c0015a490 2024-08-17T02:27:21.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.390+0000 7f3bf7e00640 1 --2- 172.21.15.42:0/1692027695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0015a490 0x7f3c000ca8b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009910 tx=0x7f3be80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d03e217e00d80d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bfe000640 1 -- 172.21.15.42:0/1692027695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be802add0 con 0x7f3c0015a490 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bfe000640 1 -- 172.21.15.42:0/1692027695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8032440 con 0x7f3c0015a490 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bfe000640 1 -- 172.21.15.42:0/1692027695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032820 con 0x7f3c0015a490 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 -- 172.21.15.42:0/1692027695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0015a490 msgr2=0x7f3c000ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 --2- 172.21.15.42:0/1692027695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0015a490 0x7f3c000ca8b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009910 tx=0x7f3be80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 -- 172.21.15.42:0/1692027695 shutdown_connections 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 --2- 172.21.15.42:0/1692027695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c000b1920 0x7f3c000b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 --2- 172.21.15.42:0/1692027695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0015a490 0x7f3c000ca8b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 -- 172.21.15.42:0/1692027695 >> 172.21.15.42:0/1692027695 conn(0x7f3c0006e590 msgr2=0x7f3c0006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 -- 172.21.15.42:0/1692027695 shutdown_connections 2024-08-17T02:27:21.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.391+0000 7f3bffe00640 1 -- 172.21.15.42:0/1692027695 wait complete. 2024-08-17T02:27:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 Processor -- start 2024-08-17T02:27:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 -- start start 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c000b1920 0x7f3c000c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 0x7f3c000c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0015a490 0x7f3c00151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c9070 con 0x7f3c00158c60 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c46b0 con 0x7f3c000b1920 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.393+0000 7f3bffe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c4990 con 0x7f3c0015a490 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 0x7f3c000c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 0x7f3c000c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47696/0 (socket says 172.21.15.42:47696) 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 -- 172.21.15.42:0/235713130 learned_addr learned my addr 172.21.15.42:0/235713130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bfea00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c000b1920 0x7f3c000c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bff400640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0015a490 0x7f3c00151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 -- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0015a490 msgr2=0x7f3c00151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0015a490 0x7f3c00151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 -- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c000b1920 msgr2=0x7f3c000c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c000b1920 0x7f3c000c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 -- 172.21.15.42:0/235713130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009450 con 0x7f3c00158c60 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bff400640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0015a490 0x7f3c00151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.394+0000 7f3bf7e00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 0x7f3c000c8b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3be8035040 tx=0x7f3be8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.395+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8031bb0 con 0x7f3c00158c60 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.395+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8031d70 con 0x7f3c00158c60 2024-08-17T02:27:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.395+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000c4c70 con 0x7f3c00158c60 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.395+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be803d670 con 0x7f3c00158c60 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.395+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000c5230 con 0x7f3c00158c60 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.396+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000c5420 con 0x7f3c00158c60 2024-08-17T02:27:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.397+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f3be8039040 con 0x7f3c00158c60 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.397+0000 7f3bf6000640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bdc0650c0 0x7f3bdc067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.397+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3be80a22a0 con 0x7f3c00158c60 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.398+0000 7f3bfea00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bdc0650c0 0x7f3bdc067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.398+0000 7f3bfea00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bdc0650c0 0x7f3bdc067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00037c0 tx=0x7f3bf0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.402+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3be80706f0 con 0x7f3c00158c60 2024-08-17T02:27:21.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.605+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c00070720 con 0x7f3c00158c60 2024-08-17T02:27:21.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.606+0000 7f3bf6000640 1 -- 172.21.15.42:0/235713130 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12092 (secure 0 0 0) 0x7f3be8037090 con 0x7f3c00158c60 2024-08-17T02:27:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:21.607 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:21.169222+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bdc0650c0 msgr2=0x7f3bdc067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bdc0650c0 0x7f3bdc067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00037c0 tx=0x7f3bf0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 msgr2=0x7f3c000c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 0x7f3c000c8b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3be8035040 tx=0x7f3be8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 shutdown_connections 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bdc0650c0 0x7f3bdc067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c0015a490 0x7f3c00151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c00158c60 0x7f3c000c8b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 --2- 172.21.15.42:0/235713130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c000b1920 0x7f3c000c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 >> 172.21.15.42:0/235713130 conn(0x7f3c0006e590 msgr2=0x7f3c000cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 shutdown_connections 2024-08-17T02:27:21.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.608+0000 7f3bffe00640 1 -- 172.21.15.42:0/235713130 wait complete. 2024-08-17T02:27:21.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:21.625 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.782+0000 7f584cc00640 1 Processor -- start 2024-08-17T02:27:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.782+0000 7f584cc00640 1 -- start start 2024-08-17T02:27:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f584cc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5848158ad0 0x7f58480ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f584cc00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58480cc480 0x7f58480cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f584cc00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58480ced30 con 0x7f58480ca4d0 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f584cc00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58480af500 con 0x7f58480cc480 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f584cc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58480cd770 con 0x7f5848158ad0 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f583fe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58480cc480 0x7f58480cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f5847e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f58480ca4d0 0x7f58480ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37304/0 (socket says 172.21.15.42:37304) 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f5847e00640 1 -- 172.21.15.42:0/1112555971 learned_addr learned my addr 172.21.15.42:0/1112555971 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f5847400640 1 --2- 172.21.15.42:0/1112555971 >> v2:172.21.15.62:3300/0 conn(0x7f5848158ad0 0x7f58480ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f583fe00640 1 -- 172.21.15.42:0/1112555971 >> v2:172.21.15.62:3300/0 conn(0x7f5848158ad0 msgr2=0x7f58480ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f583fe00640 1 --2- 172.21.15.42:0/1112555971 >> v2:172.21.15.62:3300/0 conn(0x7f5848158ad0 0x7f58480ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f583fe00640 1 -- 172.21.15.42:0/1112555971 >> v1:172.21.15.42:6789/0 conn(0x7f58480ca4d0 legacy=0x7f58480ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.785+0000 7f583fe00640 1 -- 172.21.15.42:0/1112555971 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58480cda30 con 0x7f58480cc480 2024-08-17T02:27:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.784+0000 7f5846a00640 1 -- 172.21.15.42:0/1112555971 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010922000 0 0) 0x7f5840001490 con 0x7f58480ca4d0 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.785+0000 7f583fe00640 1 --2- 172.21.15.42:0/1112555971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480cc880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5848063a40 tx=0x7f58300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c30ac7aae564221 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f5846a00640 1 -- 172.21.15.42:0/1112555971 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583002ae40 con 0x7f58480cc480 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f5846a00640 1 -- 172.21.15.42:0/1112555971 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830032440 con 0x7f58480cc480 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f5846a00640 1 -- 172.21.15.42:0/1112555971 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300327e0 con 0x7f58480cc480 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f584cc00640 1 -- 172.21.15.42:0/1112555971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 msgr2=0x7f58480cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f584cc00640 1 --2- 172.21.15.42:0/1112555971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480cc880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5848063a40 tx=0x7f58300090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f584cc00640 1 -- 172.21.15.42:0/1112555971 shutdown_connections 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f584cc00640 1 --2- 172.21.15.42:0/1112555971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480cc880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f584cc00640 1 --2- 172.21.15.42:0/1112555971 >> v2:172.21.15.62:3300/0 conn(0x7f5848158ad0 0x7f58480ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.786+0000 7f584cc00640 1 -- 172.21.15.42:0/1112555971 >> 172.21.15.42:0/1112555971 conn(0x7f5848087ad0 msgr2=0x7f584806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.787+0000 7f584cc00640 1 -- 172.21.15.42:0/1112555971 shutdown_connections 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.787+0000 7f584cc00640 1 -- 172.21.15.42:0/1112555971 wait complete. 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.788+0000 7f584cc00640 1 Processor -- start 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.788+0000 7f584cc00640 1 -- start start 2024-08-17T02:27:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f584cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480ca4d0 0x7f5848154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f584cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f584cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5848158ad0 0x7f58480c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f584cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c81d0 con 0x7f58480cc480 2024-08-17T02:27:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f584cc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5848154dd0 con 0x7f5848158ad0 2024-08-17T02:27:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f584cc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58480c75c0 con 0x7f58480ca4d0 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f583fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f583fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47730/0 (socket says 172.21.15.42:47730) 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f583fe00640 1 -- 172.21.15.42:0/224613606 learned_addr learned my addr 172.21.15.42:0/224613606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f5847400640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480ca4d0 0x7f5848154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.789+0000 7f5847e00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5848158ad0 0x7f58480c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583fe00640 1 -- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480ca4d0 msgr2=0x7f5848154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583fe00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480ca4d0 0x7f5848154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583fe00640 1 -- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5848158ad0 msgr2=0x7f58480c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583fe00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5848158ad0 0x7f58480c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583fe00640 1 -- 172.21.15.42:0/224613606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830009390 con 0x7f58480cc480 2024-08-17T02:27:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583fe00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480c6c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5830009880 tx=0x7f5830032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830000d10 con 0x7f58480cc480 2024-08-17T02:27:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830031a60 con 0x7f58480cc480 2024-08-17T02:27:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830031e60 con 0x7f58480cc480 2024-08-17T02:27:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.790+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58480c78a0 con 0x7f58480cc480 2024-08-17T02:27:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.791+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58480c7e60 con 0x7f58480cc480 2024-08-17T02:27:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.792+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58480c8380 con 0x7f58480cc480 2024-08-17T02:27:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.793+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f583003c400 con 0x7f58480cc480 2024-08-17T02:27:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.794+0000 7f583ea00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58240650c0 0x7f5824067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.794+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f583002ae40 con 0x7f58480cc480 2024-08-17T02:27:21.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.798+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f58480c8380 con 0x7f58480cc480 2024-08-17T02:27:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.801+0000 7f5847400640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58240650c0 0x7f5824067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.801+0000 7f5847400640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58240650c0 0x7f5824067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5838009c80 tx=0x7f58380090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.989+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5848070720 con 0x7f58480cc480 2024-08-17T02:27:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.989+0000 7f583ea00640 1 -- 172.21.15.42:0/224613606 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58300430a0 con 0x7f58480cc480 2024-08-17T02:27:21.991 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58240650c0 msgr2=0x7f5824067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58240650c0 0x7f5824067570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5838009c80 tx=0x7f58380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 msgr2=0x7f58480c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480c6c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5830009880 tx=0x7f5830032000 comp rx=0 tx=0).stop 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 shutdown_connections 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58240650c0 0x7f5824067570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5848158ad0 0x7f58480c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58480cc480 0x7f58480c6c50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 --2- 172.21.15.42:0/224613606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58480ca4d0 0x7f5848154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 >> 172.21.15.42:0/224613606 conn(0x7f5848087ad0 msgr2=0x7f5848157b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 shutdown_connections 2024-08-17T02:27:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:21.992+0000 7f584cc00640 1 -- 172.21.15.42:0/224613606 wait complete. 2024-08-17T02:27:22.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:27:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.165+0000 7fc225c00640 1 Processor -- start 2024-08-17T02:27:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.165+0000 7fc225c00640 1 -- start start 2024-08-17T02:27:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc22015a490 0x7fc2200ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc2200b1920 0x7fc2200b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22015b6b0 con 0x7fc220158c60 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2200b0540 con 0x7fc2200b1920 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22015a8b0 con 0x7fc22015a490 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc2200b1920 0x7fc2200b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc2200b1920 0x7fc2200b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47746/0 (socket says 172.21.15.42:47746) 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc225200640 1 -- 172.21.15.42:0/3605242180 learned_addr learned my addr 172.21.15.42:0/3605242180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.166+0000 7fc21f400640 1 --2- 172.21.15.42:0/3605242180 >> v2:172.21.15.62:3300/0 conn(0x7fc22015a490 0x7fc2200ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.167+0000 7fc225200640 1 -- 172.21.15.42:0/3605242180 >> v2:172.21.15.62:3300/0 conn(0x7fc22015a490 msgr2=0x7fc2200ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.167+0000 7fc225200640 1 --2- 172.21.15.42:0/3605242180 >> v2:172.21.15.62:3300/0 conn(0x7fc22015a490 0x7fc2200ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.167+0000 7fc225200640 1 -- 172.21.15.42:0/3605242180 >> v1:172.21.15.62:6789/0 conn(0x7fc220158c60 legacy=0x7fc220159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.167+0000 7fc225200640 1 -- 172.21.15.42:0/3605242180 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22015aac0 con 0x7fc2200b1920 2024-08-17T02:27:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.167+0000 7fc21f400640 1 --2- 172.21.15.42:0/3605242180 >> v2:172.21.15.62:3300/0 conn(0x7fc22015a490 0x7fc2200ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.168+0000 7fc225200640 1 --2- 172.21.15.42:0/3605242180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2200b1920 0x7fc2200b1d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2200cd4d0 tx=0x7fc218009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5427ae36a1dbdf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.168+0000 7fc21ea00640 1 -- 172.21.15.42:0/3605242180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218031400 con 0x7fc2200b1920 2024-08-17T02:27:22.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.168+0000 7fc21ea00640 1 -- 172.21.15.42:0/3605242180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21802d050 con 0x7fc2200b1920 2024-08-17T02:27:22.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.168+0000 7fc21ea00640 1 -- 172.21.15.42:0/3605242180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180317d0 con 0x7fc2200b1920 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 -- 172.21.15.42:0/3605242180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2200b1920 msgr2=0x7fc2200b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 --2- 172.21.15.42:0/3605242180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2200b1920 0x7fc2200b1d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc2200cd4d0 tx=0x7fc218009840 comp rx=0 tx=0).stop 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 -- 172.21.15.42:0/3605242180 shutdown_connections 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 --2- 172.21.15.42:0/3605242180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2200b1920 0x7fc2200b1d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 --2- 172.21.15.42:0/3605242180 >> v2:172.21.15.62:3300/0 conn(0x7fc22015a490 0x7fc2200ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 -- 172.21.15.42:0/3605242180 >> 172.21.15.42:0/3605242180 conn(0x7fc22006e590 msgr2=0x7fc22006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 -- 172.21.15.42:0/3605242180 shutdown_connections 2024-08-17T02:27:22.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.169+0000 7fc225c00640 1 -- 172.21.15.42:0/3605242180 wait complete. 2024-08-17T02:27:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.171+0000 7fc225c00640 1 Processor -- start 2024-08-17T02:27:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.171+0000 7fc225c00640 1 -- start start 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.172+0000 7fc225c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2200b1920 0x7fc2200c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.172+0000 7fc225c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 0x7fc220155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc225c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc22015a490 0x7fc2200b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc225c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc220168840 con 0x7fc220158c60 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc225c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc220169680 con 0x7fc2200b1920 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc225c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2201557d0 con 0x7fc22015a490 2024-08-17T02:27:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 0x7fc220155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 0x7fc220155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47748/0 (socket says 172.21.15.42:47748) 2024-08-17T02:27:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21fe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2200b1920 0x7fc2200c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 -- 172.21.15.42:0/1451579006 learned_addr learned my addr 172.21.15.42:0/1451579006 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc225200640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc22015a490 0x7fc2200b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 -- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc22015a490 msgr2=0x7fc2200b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc22015a490 0x7fc2200b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 -- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2200b1920 msgr2=0x7fc2200c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2200b1920 0x7fc2200c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.173+0000 7fc21f400640 1 -- 172.21.15.42:0/1451579006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218009ae0 con 0x7fc220158c60 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.174+0000 7fc21f400640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 0x7fc220155290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00d810 tx=0x7fc20c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.174+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00de00 con 0x7fc220158c60 2024-08-17T02:27:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.174+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c009850 con 0x7fc220158c60 2024-08-17T02:27:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.174+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc220168a70 con 0x7fc220158c60 2024-08-17T02:27:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.174+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c009c10 con 0x7fc220158c60 2024-08-17T02:27:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.174+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc220169030 con 0x7fc220158c60 2024-08-17T02:27:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.175+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc220070720 con 0x7fc220158c60 2024-08-17T02:27:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.176+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fc20c014430 con 0x7fc220158c60 2024-08-17T02:27:22.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.177+0000 7fc217400640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc2000650c0 0x7fc200067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.177+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc20c0821e0 con 0x7fc220158c60 2024-08-17T02:27:22.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.177+0000 7fc21fe00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc2000650c0 0x7fc200067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.178+0000 7fc21fe00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc2000650c0 0x7fc200067570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc210007fd0 tx=0x7fc210007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.183+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc20c050780 con 0x7fc220158c60 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.369+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc2200c3500 con 0x7fc220158c60 2024-08-17T02:27:22.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.369+0000 7fc217400640 1 -- 172.21.15.42:0/1451579006 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc20c053da0 con 0x7fc220158c60 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:27:22.371 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc2000650c0 msgr2=0x7fc200067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc2000650c0 0x7fc200067570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc210007fd0 tx=0x7fc210007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 msgr2=0x7fc220155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 0x7fc220155290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00d810 tx=0x7fc20c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 shutdown_connections 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc2000650c0 0x7fc200067570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc22015a490 0x7fc2200b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc220158c60 0x7fc220155290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 --2- 172.21.15.42:0/1451579006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc2200b1920 0x7fc2200c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 >> 172.21.15.42:0/1451579006 conn(0x7fc22006e590 msgr2=0x7fc2200cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 shutdown_connections 2024-08-17T02:27:22.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.371+0000 7fc225c00640 1 -- 172.21.15.42:0/1451579006 wait complete. 2024-08-17T02:27:22.388 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:27:22.388 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:27:22.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.545+0000 7f1911200640 1 Processor -- start 2024-08-17T02:27:22.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.545+0000 7f1911200640 1 -- start start 2024-08-17T02:27:22.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.546+0000 7f1911200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f190c1589f0 0x7f190c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.546+0000 7f1911200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.546+0000 7f1911200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190c0b3ac0 con 0x7f190c0cf520 2024-08-17T02:27:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.546+0000 7f1911200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190c0cf260 con 0x7f190c1589f0 2024-08-17T02:27:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.546+0000 7f1911200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c0b3190 con 0x7f190c158dc0 2024-08-17T02:27:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190b400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f190c1589f0 0x7f190c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:50264/0 (socket says 172.21.15.42:50264) 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190aa00640 1 -- 172.21.15.42:0/3632670072 learned_addr learned my addr 172.21.15.42:0/3632670072 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190b400640 1 -- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 msgr2=0x7f190c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190b400640 1 --2- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190b400640 1 -- 172.21.15.42:0/3632670072 >> v1:172.21.15.62:6789/0 conn(0x7f190c0cf520 legacy=0x7f190c0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190b400640 1 -- 172.21.15.42:0/3632670072 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c0b3470 con 0x7f190c1589f0 2024-08-17T02:27:22.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.547+0000 7f190aa00640 1 --2- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.548+0000 7f190b400640 1 --2- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c0ce7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009850 tx=0x7f18fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccca886b565dd421 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.548+0000 7f190a000640 1 -- 172.21.15.42:0/3632670072 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc02ad80 con 0x7f190c1589f0 2024-08-17T02:27:22.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.548+0000 7f190a000640 1 -- 172.21.15.42:0/3632670072 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc032440 con 0x7f190c1589f0 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.548+0000 7f190a000640 1 -- 172.21.15.42:0/3632670072 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18fc032820 con 0x7f190c1589f0 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 -- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 msgr2=0x7f190c0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 --2- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c0ce7e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009850 tx=0x7f18fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 -- 172.21.15.42:0/3632670072 shutdown_connections 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 --2- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 --2- 172.21.15.42:0/3632670072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c0ce7e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 -- 172.21.15.42:0/3632670072 >> 172.21.15.42:0/3632670072 conn(0x7f190c087a80 msgr2=0x7f190c06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 -- 172.21.15.42:0/3632670072 shutdown_connections 2024-08-17T02:27:22.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.549+0000 7f1911200640 1 -- 172.21.15.42:0/3632670072 wait complete. 2024-08-17T02:27:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.550+0000 7f1911200640 1 Processor -- start 2024-08-17T02:27:22.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.551+0000 7f1911200640 1 -- start start 2024-08-17T02:27:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.551+0000 7f1911200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f190c0cf520 0x7f190c16ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f1911200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f1911200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f1911200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c16d410 con 0x7f190c0cf520 2024-08-17T02:27:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f1911200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c16ca40 con 0x7f190c1589f0 2024-08-17T02:27:22.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f1911200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c14e930 con 0x7f190c158dc0 2024-08-17T02:27:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f190c0cf520 0x7f190c16ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:46084/0 (socket says 172.21.15.42:46084) 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 -- 172.21.15.42:0/1820496448 learned_addr learned my addr 172.21.15.42:0/1820496448 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 -- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 msgr2=0x7f190c0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 -- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f190c0cf520 msgr2=0x7f190c16ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f190c0cf520 0x7f190c16ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190aa00640 1 -- 172.21.15.42:0/1820496448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009450 con 0x7f190c1589f0 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.552+0000 7f190b400640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f190c0cf520 0x7f190c16ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.553+0000 7f190aa00640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c14e3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18f800ea90 tx=0x7f18f80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.553+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800ca10 con 0x7f190c1589f0 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.553+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800cb70 con 0x7f190c1589f0 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.553+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8013470 con 0x7f190c1589f0 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.553+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc009390 con 0x7f190c1589f0 2024-08-17T02:27:22.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.553+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190c0b1620 con 0x7f190c1589f0 2024-08-17T02:27:22.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.554+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190c063e70 con 0x7f190c1589f0 2024-08-17T02:27:22.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.555+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f18f8013820 con 0x7f190c1589f0 2024-08-17T02:27:22.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.556+0000 7f1902a00640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f18ec0650c0 0x7f18ec067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.556+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f18f8082360 con 0x7f190c1589f0 2024-08-17T02:27:22.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.556+0000 7f190b400640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f18ec0650c0 0x7f18ec067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.556+0000 7f190b400640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f18ec0650c0 0x7f18ec067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18fc034000 tx=0x7f18fc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.561+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f18f8050860 con 0x7f190c1589f0 2024-08-17T02:27:22.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:22.744+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f190c088a10 con 0x7f190c1589f0 2024-08-17T02:27:23.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.422+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f18f8050c30 con 0x7f190c1589f0 2024-08-17T02:27:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.423+0000 7f1902a00640 1 -- 172.21.15.42:0/1820496448 <== mon.1 v2:172.21.15.62:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f18f807ba80 con 0x7f190c1589f0 2024-08-17T02:27:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-08-17T02:27:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f18ec0650c0 msgr2=0x7f18ec067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f18ec0650c0 0x7f18ec067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18fc034000 tx=0x7f18fc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 msgr2=0x7f190c14e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c14e3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f18f800ea90 tx=0x7f18f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 shutdown_connections 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f18ec0650c0 0x7f18ec067570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f190c158dc0 0x7f190c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f190c1589f0 0x7f190c14e3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 --2- 172.21.15.42:0/1820496448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f190c0cf520 0x7f190c16ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.428+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 >> 172.21.15.42:0/1820496448 conn(0x7f190c087a80 msgr2=0x7f190c159190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.429+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 shutdown_connections 2024-08-17T02:27:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.429+0000 7f1911200640 1 -- 172.21.15.42:0/1820496448 wait complete. 2024-08-17T02:27:23.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:27:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.606+0000 7f5827200640 1 Processor -- start 2024-08-17T02:27:23.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.606+0000 7f5827200640 1 -- start start 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f5827200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58280cfad0 0x7f58280b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f5827200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280d0550 con 0x7f58280ccf50 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f5827200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280cd3f0 con 0x7f5828158dc0 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f5827200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280d0270 con 0x7f58280cfad0 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f581d400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f58280ccf50 0x7f58280cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37318/0 (socket says 172.21.15.42:37318) 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f581d400640 1 -- 172.21.15.42:0/1714632040 learned_addr learned my addr 172.21.15.42:0/1714632040 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:23.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f5826800640 1 --2- 172.21.15.42:0/1714632040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58280cfad0 0x7f58280b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.607+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806669681 0 0) 0x7f58280d0550 con 0x7f58280ccf50 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.608+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f580c0034e0 con 0x7f58280ccf50 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.608+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259624183 0 0) 0x7f58280cd3f0 con 0x7f5828158dc0 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.608+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58280d0550 con 0x7f5828158dc0 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.608+0000 7f5826800640 1 -- 172.21.15.42:0/1714632040 >> v1:172.21.15.62:6789/0 conn(0x7f5828158dc0 legacy=0x7f58280b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.608+0000 7f5826800640 1 -- 172.21.15.42:0/1714632040 >> v1:172.21.15.42:6789/0 conn(0x7f58280ccf50 legacy=0x7f58280cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.608+0000 7f5826800640 1 -- 172.21.15.42:0/1714632040 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280caa80 con 0x7f58280cfad0 2024-08-17T02:27:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.609+0000 7f5826800640 1 --2- 172.21.15.42:0/1714632040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58280cfad0 0x7f58280b1a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e90 tx=0x7f5820009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fedbd38e28f4d11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.609+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820007550 con 0x7f58280cfad0 2024-08-17T02:27:23.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.609+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582002d050 con 0x7f58280cfad0 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.609+0000 7f5825400640 1 -- 172.21.15.42:0/1714632040 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200078c0 con 0x7f58280cfad0 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 -- 172.21.15.42:0/1714632040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58280cfad0 msgr2=0x7f58280b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 --2- 172.21.15.42:0/1714632040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58280cfad0 0x7f58280b1a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e90 tx=0x7f5820009780 comp rx=0 tx=0).stop 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 -- 172.21.15.42:0/1714632040 shutdown_connections 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 --2- 172.21.15.42:0/1714632040 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58280cfad0 0x7f58280b1a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 -- 172.21.15.42:0/1714632040 >> 172.21.15.42:0/1714632040 conn(0x7f5828068570 msgr2=0x7f5828068940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 -- 172.21.15.42:0/1714632040 shutdown_connections 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.610+0000 7f5827200640 1 -- 172.21.15.42:0/1714632040 wait complete. 2024-08-17T02:27:23.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.611+0000 7f5827200640 1 Processor -- start 2024-08-17T02:27:23.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.611+0000 7f5827200640 1 -- start start 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5827200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280ccf50 0x7f5828169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5827200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 0x7f5828159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5827200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5828158dc0 0x7f58281655b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5827200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58281696c0 con 0x7f58280cfad0 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5827200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c87c0 con 0x7f58280ccf50 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5827200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582815a990 con 0x7f5828158dc0 2024-08-17T02:27:23.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f581d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 0x7f5828159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f581d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 0x7f5828159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47766/0 (socket says 172.21.15.42:47766) 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f581d400640 1 -- 172.21.15.42:0/2737014683 learned_addr learned my addr 172.21.15.42:0/2737014683 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.612+0000 7f5825e00640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280ccf50 0x7f5828169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f5826800640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5828158dc0 0x7f58281655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581d400640 1 -- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5828158dc0 msgr2=0x7f58281655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581d400640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5828158dc0 0x7f58281655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581d400640 1 -- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280ccf50 msgr2=0x7f5828169180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581d400640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280ccf50 0x7f5828169180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581d400640 1 -- 172.21.15.42:0/2737014683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009a20 con 0x7f58280cfad0 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f5826800640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5828158dc0 0x7f58281655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581d400640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 0x7f5828159330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f581000c580 tx=0x7f5810007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5810005aa0 con 0x7f58280cfad0 2024-08-17T02:27:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5810005c00 con 0x7f58280cfad0 2024-08-17T02:27:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58100070d0 con 0x7f58280cfad0 2024-08-17T02:27:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582815bce0 con 0x7f58280cfad0 2024-08-17T02:27:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.613+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582815b1a0 con 0x7f58280cfad0 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.614+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828070720 con 0x7f58280cfad0 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.615+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5810007480 con 0x7f58280cfad0 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.616+0000 7f581e000640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58040651d0 0x7f5804067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.616+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f5810081720 con 0x7f58280cfad0 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.616+0000 7f5825e00640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58040651d0 0x7f5804067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.617+0000 7f5825e00640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58040651d0 0x7f5804067680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5818003a10 tx=0x7f5818007cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.621+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f581004f9d0 con 0x7f58280cfad0 2024-08-17T02:27:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:23.807+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5828067490 con 0x7f58280cfad0 2024-08-17T02:27:24.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.419+0000 7f581e000640 1 -- 172.21.15.42:0/2737014683 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5810052ff0 con 0x7f58280cfad0 2024-08-17T02:27:24.421 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-08-17T02:27:24.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.429+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58040651d0 msgr2=0x7f5804067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.429+0000 7f5827200640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58040651d0 0x7f5804067680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5818003a10 tx=0x7f5818007cc0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.429+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 msgr2=0x7f5828159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.429+0000 7f5827200640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 0x7f5828159330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f581000c580 tx=0x7f5810007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:24.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.430+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 shutdown_connections 2024-08-17T02:27:24.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.430+0000 7f5827200640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f58040651d0 0x7f5804067680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.430+0000 7f5827200640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5828158dc0 0x7f58281655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.430+0000 7f5827200640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58280cfad0 0x7f5828159330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.430+0000 7f5827200640 1 --2- 172.21.15.42:0/2737014683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280ccf50 0x7f5828169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.430+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 >> 172.21.15.42:0/2737014683 conn(0x7f5828068570 msgr2=0x7f58280b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.431+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 shutdown_connections 2024-08-17T02:27:24.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.431+0000 7f5827200640 1 -- 172.21.15.42:0/2737014683 wait complete. 2024-08-17T02:27:24.462 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:27:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.618+0000 7fbe52600640 1 Processor -- start 2024-08-17T02:27:24.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.618+0000 7fbe52600640 1 -- start start 2024-08-17T02:27:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe52600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe4c158b90 0x7fbe4c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe52600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe4c0b2370 0x7fbe4c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe52600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0afd20 con 0x7fbe4c0aef60 2024-08-17T02:27:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe52600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0af330 con 0x7fbe4c158b90 2024-08-17T02:27:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe52600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0affe0 con 0x7fbe4c0b2370 2024-08-17T02:27:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe4b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe4c158b90 0x7fbe4c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe4b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe4c158b90 0x7fbe4c0b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47776/0 (socket says 172.21.15.42:47776) 2024-08-17T02:27:24.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.619+0000 7fbe4b400640 1 -- 172.21.15.42:0/4180685609 learned_addr learned my addr 172.21.15.42:0/4180685609 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.620+0000 7fbe4aa00640 1 --2- 172.21.15.42:0/4180685609 >> v2:172.21.15.62:3300/0 conn(0x7fbe4c0b2370 0x7fbe4c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.620+0000 7fbe4b400640 1 -- 172.21.15.42:0/4180685609 >> v2:172.21.15.62:3300/0 conn(0x7fbe4c0b2370 msgr2=0x7fbe4c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.620+0000 7fbe4b400640 1 --2- 172.21.15.42:0/4180685609 >> v2:172.21.15.62:3300/0 conn(0x7fbe4c0b2370 0x7fbe4c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.620+0000 7fbe4b400640 1 -- 172.21.15.42:0/4180685609 >> v1:172.21.15.62:6789/0 conn(0x7fbe4c0aef60 legacy=0x7fbe4c068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.620+0000 7fbe4b400640 1 -- 172.21.15.42:0/4180685609 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0b02c0 con 0x7fbe4c158b90 2024-08-17T02:27:24.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.621+0000 7fbe4b400640 1 --2- 172.21.15.42:0/4180685609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c158b90 0x7fbe4c0b1e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0b56c0 tx=0x7fbe3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7cda47dfcbb8c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.621+0000 7fbe4a000640 1 -- 172.21.15.42:0/4180685609 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c02ae80 con 0x7fbe4c158b90 2024-08-17T02:27:24.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.621+0000 7fbe4a000640 1 -- 172.21.15.42:0/4180685609 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c032440 con 0x7fbe4c158b90 2024-08-17T02:27:24.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.621+0000 7fbe4a000640 1 -- 172.21.15.42:0/4180685609 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c032800 con 0x7fbe4c158b90 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.621+0000 7fbe52600640 1 -- 172.21.15.42:0/4180685609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c158b90 msgr2=0x7fbe4c0b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.621+0000 7fbe52600640 1 --2- 172.21.15.42:0/4180685609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c158b90 0x7fbe4c0b1e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0b56c0 tx=0x7fbe3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.622+0000 7fbe52600640 1 -- 172.21.15.42:0/4180685609 shutdown_connections 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.622+0000 7fbe52600640 1 --2- 172.21.15.42:0/4180685609 >> v2:172.21.15.62:3300/0 conn(0x7fbe4c0b2370 0x7fbe4c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.622+0000 7fbe52600640 1 --2- 172.21.15.42:0/4180685609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c158b90 0x7fbe4c0b1e30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.622+0000 7fbe52600640 1 -- 172.21.15.42:0/4180685609 >> 172.21.15.42:0/4180685609 conn(0x7fbe4c06e590 msgr2=0x7fbe4c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.622+0000 7fbe52600640 1 -- 172.21.15.42:0/4180685609 shutdown_connections 2024-08-17T02:27:24.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.622+0000 7fbe52600640 1 -- 172.21.15.42:0/4180685609 wait complete. 2024-08-17T02:27:24.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.623+0000 7fbe52600640 1 Processor -- start 2024-08-17T02:27:24.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.623+0000 7fbe52600640 1 -- start start 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe52600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe4c0aef60 0x7fbe4c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe52600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 0x7fbe4c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe52600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe4c158b90 0x7fbe4c15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe52600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c15ecc0 con 0x7fbe4c0b2370 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe52600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c1587c0 con 0x7fbe4c158b90 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe52600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c15d110 con 0x7fbe4c0aef60 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe4aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 0x7fbe4c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe4aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 0x7fbe4c0c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47790/0 (socket says 172.21.15.42:47790) 2024-08-17T02:27:24.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe4aa00640 1 -- 172.21.15.42:0/3354718252 learned_addr learned my addr 172.21.15.42:0/3354718252 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe4b400640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe4c0aef60 0x7fbe4c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.624+0000 7fbe4be00640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe4c158b90 0x7fbe4c15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe4aa00640 1 -- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe4c0aef60 msgr2=0x7fbe4c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe4aa00640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe4c0aef60 0x7fbe4c158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe4aa00640 1 -- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe4c158b90 msgr2=0x7fbe4c15d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe4aa00640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe4c158b90 0x7fbe4c15d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe4aa00640 1 -- 172.21.15.42:0/3354718252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009450 con 0x7fbe4c0b2370 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe4aa00640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 0x7fbe4c0c8bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800d890 tx=0x7fbe38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800b660 con 0x7fbe4c0b2370 2024-08-17T02:27:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3800b7e0 con 0x7fbe4c0b2370 2024-08-17T02:27:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c0c9170 con 0x7fbe4c0b2370 2024-08-17T02:27:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800bba0 con 0x7fbe4c0b2370 2024-08-17T02:27:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.625+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c15cac0 con 0x7fbe4c0b2370 2024-08-17T02:27:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.627+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c15d280 con 0x7fbe4c0b2370 2024-08-17T02:27:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.627+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe3801e460 con 0x7fbe4c0b2370 2024-08-17T02:27:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.628+0000 7fbe42a00640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe2c065150 0x7fbe2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.628+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fbe38082910 con 0x7fbe4c0b2370 2024-08-17T02:27:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.628+0000 7fbe4b400640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe2c065150 0x7fbe2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.629+0000 7fbe4b400640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe2c065150 0x7fbe2c067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c034000 tx=0x7fbe3c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.633+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbe38050b00 con 0x7fbe4c0b2370 2024-08-17T02:27:24.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:24.859+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbe4c063fb0 con 0x7fbe4c0b2370 2024-08-17T02:27:25.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.435+0000 7fbe42a00640 1 -- 172.21.15.42:0/3354718252 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbe38054120 con 0x7fbe4c0b2370 2024-08-17T02:27:25.439 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe2c065150 msgr2=0x7fbe2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe2c065150 0x7fbe2c067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c034000 tx=0x7fbe3c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 msgr2=0x7fbe4c0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 0x7fbe4c0c8bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800d890 tx=0x7fbe38008040 comp rx=0 tx=0).stop 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 shutdown_connections 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe2c065150 0x7fbe2c067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe4c158b90 0x7fbe4c15d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe4c0b2370 0x7fbe4c0c8bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 --2- 172.21.15.42:0/3354718252 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe4c0aef60 0x7fbe4c158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.444+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 >> 172.21.15.42:0/3354718252 conn(0x7fbe4c06e590 msgr2=0x7fbe4c0cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.445+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 shutdown_connections 2024-08-17T02:27:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.446+0000 7fbe52600640 1 -- 172.21.15.42:0/3354718252 wait complete. 2024-08-17T02:27:25.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:25.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.627+0000 7f8560000640 1 Processor -- start 2024-08-17T02:27:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.627+0000 7f8560000640 1 -- start start 2024-08-17T02:27:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.628+0000 7f8560000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8558158b90 0x7f85580b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.628+0000 7f8560000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 0x7f85580aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.628+0000 7f8560000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85580af380 con 0x7f85580aef60 2024-08-17T02:27:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.628+0000 7f8560000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580afd20 con 0x7f8558158b90 2024-08-17T02:27:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.628+0000 7f8560000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580affe0 con 0x7f85580b2370 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 0x7f85580aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 0x7f85580aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:50300/0 (socket says 172.21.15.42:50300) 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 -- 172.21.15.42:0/1619135781 learned_addr learned my addr 172.21.15.42:0/1619135781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855d600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8558158b90 0x7f85580b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855e000640 1 --1- 172.21.15.42:0/1619135781 >> v1:172.21.15.62:6789/0 conn(0x7f85580aef60 0x7f8558068630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:43762/0 (socket says 172.21.15.42:43762) 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 -- 172.21.15.42:0/1619135781 >> v2:172.21.15.62:3300/0 conn(0x7f8558158b90 msgr2=0x7f85580b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 --2- 172.21.15.42:0/1619135781 >> v2:172.21.15.62:3300/0 conn(0x7f8558158b90 0x7f85580b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 -- 172.21.15.42:0/1619135781 >> v1:172.21.15.62:6789/0 conn(0x7f85580aef60 legacy=0x7f8558068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.629+0000 7f855cc00640 1 -- 172.21.15.42:0/1619135781 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580b02c0 con 0x7f85580b2370 2024-08-17T02:27:25.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.630+0000 7f855cc00640 1 --2- 172.21.15.42:0/1619135781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 0x7f85580aea20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8544009910 tx=0x7f85440091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6607c027f593b477 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.630+0000 7f8557e00640 1 -- 172.21.15.42:0/1619135781 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854402ae40 con 0x7f85580b2370 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.630+0000 7f8557e00640 1 -- 172.21.15.42:0/1619135781 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544032440 con 0x7f85580b2370 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.630+0000 7f8557e00640 1 -- 172.21.15.42:0/1619135781 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544032820 con 0x7f85580b2370 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 -- 172.21.15.42:0/1619135781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 msgr2=0x7f85580aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 --2- 172.21.15.42:0/1619135781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 0x7f85580aea20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8544009910 tx=0x7f85440091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 -- 172.21.15.42:0/1619135781 shutdown_connections 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 --2- 172.21.15.42:0/1619135781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f85580b2370 0x7f85580aea20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 --2- 172.21.15.42:0/1619135781 >> v2:172.21.15.62:3300/0 conn(0x7f8558158b90 0x7f85580b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 -- 172.21.15.42:0/1619135781 >> 172.21.15.42:0/1619135781 conn(0x7f855806e590 msgr2=0x7f855806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 -- 172.21.15.42:0/1619135781 shutdown_connections 2024-08-17T02:27:25.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.631+0000 7f8560000640 1 -- 172.21.15.42:0/1619135781 wait complete. 2024-08-17T02:27:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.633+0000 7f8560000640 1 Processor -- start 2024-08-17T02:27:25.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.633+0000 7f8560000640 1 -- start start 2024-08-17T02:27:25.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f8560000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 0x7f855815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f8560000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85580b2370 0x7f85580c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f8560000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558158b90 0x7f85580c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f8560000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855815c820 con 0x7f85580aef60 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f8560000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855815ca70 con 0x7f85580b2370 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f8560000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855815cd50 con 0x7f8558158b90 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 0x7f855815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 0x7f855815db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47792/0 (socket says 172.21.15.42:47792) 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855d600640 1 -- 172.21.15.42:0/2460870074 learned_addr learned my addr 172.21.15.42:0/2460870074 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855cc00640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85580b2370 0x7f85580c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855e000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558158b90 0x7f85580c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855cc00640 1 -- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558158b90 msgr2=0x7f85580c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855cc00640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558158b90 0x7f85580c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855cc00640 1 -- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 msgr2=0x7f855815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855cc00640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 0x7f855815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855cc00640 1 -- 172.21.15.42:0/2460870074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009450 con 0x7f85580b2370 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.634+0000 7f855d600640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 0x7f855815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.635+0000 7f855cc00640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85580b2370 0x7f85580c8e40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8544031000 tx=0x7f8544032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.635+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544031c80 con 0x7f85580b2370 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.635+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544031de0 con 0x7f85580b2370 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.635+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855815d030 con 0x7f85580b2370 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.635+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854403d670 con 0x7f85580b2370 2024-08-17T02:27:25.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.635+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855815d5f0 con 0x7f85580b2370 2024-08-17T02:27:25.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.636+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855815d7e0 con 0x7f85580b2370 2024-08-17T02:27:25.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.637+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8544039040 con 0x7f85580b2370 2024-08-17T02:27:25.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.638+0000 7f8554c00640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8538065180 0x7f8538067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.638+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f854402ae40 con 0x7f85580b2370 2024-08-17T02:27:25.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.638+0000 7f855d600640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8538065180 0x7f8538067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.638+0000 7f855d600640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8538065180 0x7f8538067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f854c0114a0 tx=0x7f854c0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.643+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8544070530 con 0x7f85580b2370 2024-08-17T02:27:25.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.825+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8558063fb0 con 0x7f85580b2370 2024-08-17T02:27:25.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.827+0000 7f8554c00640 1 -- 172.21.15.42:0/2460870074 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f8544073b50 con 0x7f85580b2370 2024-08-17T02:27:25.828 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:25.828 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:24.861096+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8538065180 msgr2=0x7f8538067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8538065180 0x7f8538067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f854c0114a0 tx=0x7f854c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85580b2370 msgr2=0x7f85580c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85580b2370 0x7f85580c8e40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8544031000 tx=0x7f8544032000 comp rx=0 tx=0).stop 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 shutdown_connections 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8538065180 0x7f8538067630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8558158b90 0x7f85580c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85580b2370 0x7f85580c8e40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.828+0000 7f8560000640 1 --2- 172.21.15.42:0/2460870074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85580aef60 0x7f855815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.829+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 >> 172.21.15.42:0/2460870074 conn(0x7f855806e590 msgr2=0x7f85580b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.829+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 shutdown_connections 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.829+0000 7f8560000640 1 -- 172.21.15.42:0/2460870074 wait complete. 2024-08-17T02:27:25.845 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.993+0000 7f3c63000640 1 Processor -- start 2024-08-17T02:27:25.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.994+0000 7f3c63000640 1 -- start start 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c63000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c63000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3c5c0b1920 0x7f3c5c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c63000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c15a880 con 0x7f3c5c158c60 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c63000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c0b0540 con 0x7f3c5c0b1920 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c63000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15b6b0 con 0x7f3c5c15a490 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c62600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3c5c0b1920 0x7f3c5c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c62600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3c5c0b1920 0x7f3c5c0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47794/0 (socket says 172.21.15.42:47794) 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c62600640 1 -- 172.21.15.42:0/32786214 learned_addr learned my addr 172.21.15.42:0/32786214 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c61c00640 1 --1- 172.21.15.42:0/32786214 >> v1:172.21.15.62:6789/0 conn(0x7f3c5c158c60 0x7f3c5c159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:43774/0 (socket says 172.21.15.42:43774) 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c61200640 1 --2- 172.21.15.42:0/32786214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c62600640 1 -- 172.21.15.42:0/32786214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 msgr2=0x7f3c5c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c62600640 1 --2- 172.21.15.42:0/32786214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.995+0000 7f3c62600640 1 -- 172.21.15.42:0/32786214 >> v1:172.21.15.62:6789/0 conn(0x7f3c5c158c60 legacy=0x7f3c5c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.996+0000 7f3c62600640 1 -- 172.21.15.42:0/32786214 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c15aac0 con 0x7f3c5c0b1920 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.996+0000 7f3c62600640 1 --2- 172.21.15.42:0/32786214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0b1d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009f20 tx=0x7f3c54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4d70dfa32917bd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c5be00640 1 -- 172.21.15.42:0/32786214 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54031400 con 0x7f3c5c0b1920 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c5be00640 1 -- 172.21.15.42:0/32786214 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5402d050 con 0x7f3c5c0b1920 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c5be00640 1 -- 172.21.15.42:0/32786214 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c540317d0 con 0x7f3c5c0b1920 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 -- 172.21.15.42:0/32786214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 msgr2=0x7f3c5c0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 --2- 172.21.15.42:0/32786214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0b1d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009f20 tx=0x7f3c54009840 comp rx=0 tx=0).stop 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 -- 172.21.15.42:0/32786214 shutdown_connections 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 --2- 172.21.15.42:0/32786214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0b1d60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 --2- 172.21.15.42:0/32786214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 -- 172.21.15.42:0/32786214 >> 172.21.15.42:0/32786214 conn(0x7f3c5c06e590 msgr2=0x7f3c5c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 -- 172.21.15.42:0/32786214 shutdown_connections 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.997+0000 7f3c63000640 1 -- 172.21.15.42:0/32786214 wait complete. 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.999+0000 7f3c63000640 1 Processor -- start 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:25.999+0000 7f3c63000640 1 -- start start 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c63000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c63000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5c158c60 0x7f3c5c0a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c63000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c63000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0cf290 con 0x7f3c5c0b1920 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c63000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0ce3e0 con 0x7f3c5c158c60 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c63000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0ce680 con 0x7f3c5c15a490 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47802/0 (socket says 172.21.15.42:47802) 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 -- 172.21.15.42:0/891255027 learned_addr learned my addr 172.21.15.42:0/891255027 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61200640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5c158c60 0x7f3c5c0a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c62600640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 -- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 msgr2=0x7f3c5c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 -- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5c158c60 msgr2=0x7f3c5c0a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5c158c60 0x7f3c5c0a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.000+0000 7f3c61c00640 1 -- 172.21.15.42:0/891255027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54009ae0 con 0x7f3c5c0b1920 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.001+0000 7f3c61c00640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0cf720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c590 tx=0x7f3c50007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.001+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50007300 con 0x7f3c5c0b1920 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.001+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c500074a0 con 0x7f3c5c0b1920 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.001+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c500047a0 con 0x7f3c5c0b1920 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.001+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c0ce960 con 0x7f3c5c0b1920 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.001+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0cef20 con 0x7f3c5c0b1920 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.002+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c070720 con 0x7f3c5c0b1920 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.003+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c50004bd0 con 0x7f3c5c0b1920 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.004+0000 7f3c58c00640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3c3c065150 0x7f3c3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.004+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c50081280 con 0x7f3c5c0b1920 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.004+0000 7f3c61200640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3c3c065150 0x7f3c3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.005+0000 7f3c61200640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3c3c065150 0x7f3c3c067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0d03f0 tx=0x7f3c480090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.008+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3c5004be40 con 0x7f3c5c0b1920 2024-08-17T02:27:26.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.194+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5c15a880 con 0x7f3c5c0b1920 2024-08-17T02:27:26.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.195+0000 7f3c58c00640 1 -- 172.21.15.42:0/891255027 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f3c5c15a880 con 0x7f3c5c0b1920 2024-08-17T02:27:26.196 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:26.196 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:24.861096+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3c3c065150 msgr2=0x7f3c3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3c3c065150 0x7f3c3c067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0d03f0 tx=0x7f3c480090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 msgr2=0x7f3c5c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0cf720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c590 tx=0x7f3c50007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 shutdown_connections 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3c3c065150 0x7f3c3c067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c5c15a490 0x7f3c5c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5c158c60 0x7f3c5c0a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 --2- 172.21.15.42:0/891255027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c5c0b1920 0x7f3c5c0cf720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 >> 172.21.15.42:0/891255027 conn(0x7f3c5c06e590 msgr2=0x7f3c5c0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 shutdown_connections 2024-08-17T02:27:26.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.197+0000 7f3c63000640 1 -- 172.21.15.42:0/891255027 wait complete. 2024-08-17T02:27:26.214 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:27:26.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.366+0000 7fb2bf800640 1 Processor -- start 2024-08-17T02:27:26.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.366+0000 7fb2bf800640 1 -- start start 2024-08-17T02:27:26.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.367+0000 7fb2bf800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ad960 0x7fb2b815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.367+0000 7fb2bf800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb2b80ca050 0x7fb2b8156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2bf800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b815b5e0 con 0x7fb2b80add30 2024-08-17T02:27:26.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2bf800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b80cb160 con 0x7fb2b80ca050 2024-08-17T02:27:26.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2bf800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80b0d10 con 0x7fb2b80ad960 2024-08-17T02:27:26.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2b7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb2b80ca050 0x7fb2b8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2bd800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb2b80add30 0x7fb2b8156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37332/0 (socket says 172.21.15.42:37332) 2024-08-17T02:27:26.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2bd800640 1 -- 172.21.15.42:0/4008830353 learned_addr learned my addr 172.21.15.42:0/4008830353 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:26.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2bce00640 1 --2- 172.21.15.42:0/4008830353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ad960 0x7fb2b815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2b7e00640 1 -- 172.21.15.42:0/4008830353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ad960 msgr2=0x7fb2b815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2b7e00640 1 --2- 172.21.15.42:0/4008830353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ad960 0x7fb2b815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2b7e00640 1 -- 172.21.15.42:0/4008830353 >> v1:172.21.15.42:6789/0 conn(0x7fb2b80add30 legacy=0x7fb2b8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.368+0000 7fb2b7e00640 1 -- 172.21.15.42:0/4008830353 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80ca550 con 0x7fb2b80ca050 2024-08-17T02:27:26.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.369+0000 7fb2b7e00640 1 --2- 172.21.15.42:0/4008830353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80ca050 0x7fb2b8156420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009850 tx=0x7fb2a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3255efa688c428 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2b7400640 1 -- 172.21.15.42:0/4008830353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a402ae20 con 0x7fb2b80ca050 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2b7400640 1 -- 172.21.15.42:0/4008830353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4032440 con 0x7fb2b80ca050 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2b7400640 1 -- 172.21.15.42:0/4008830353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4032820 con 0x7fb2b80ca050 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 -- 172.21.15.42:0/4008830353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80ca050 msgr2=0x7fb2b8156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 --2- 172.21.15.42:0/4008830353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80ca050 0x7fb2b8156420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4009850 tx=0x7fb2a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 -- 172.21.15.42:0/4008830353 shutdown_connections 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 --2- 172.21.15.42:0/4008830353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80ca050 0x7fb2b8156420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 --2- 172.21.15.42:0/4008830353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ad960 0x7fb2b815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 -- 172.21.15.42:0/4008830353 >> 172.21.15.42:0/4008830353 conn(0x7fb2b8066e60 msgr2=0x7fb2b8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 -- 172.21.15.42:0/4008830353 shutdown_connections 2024-08-17T02:27:26.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.370+0000 7fb2bf800640 1 -- 172.21.15.42:0/4008830353 wait complete. 2024-08-17T02:27:26.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.372+0000 7fb2bf800640 1 Processor -- start 2024-08-17T02:27:26.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.372+0000 7fb2bf800640 1 -- start start 2024-08-17T02:27:26.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.372+0000 7fb2bf800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b80ad960 0x7fb2b8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.372+0000 7fb2bf800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 0x7fb2b8150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bf800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ca050 0x7fb2b8150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bf800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81585b0 con 0x7fb2b80add30 2024-08-17T02:27:26.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bf800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8148960 con 0x7fb2b80ad960 2024-08-17T02:27:26.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bf800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81510c0 con 0x7fb2b80ca050 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 0x7fb2b8150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 0x7fb2b8150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47824/0 (socket says 172.21.15.42:47824) 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 -- 172.21.15.42:0/412607294 learned_addr learned my addr 172.21.15.42:0/412607294 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bce00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b80ad960 0x7fb2b8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bd800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ca050 0x7fb2b8150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 -- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ca050 msgr2=0x7fb2b8150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ca050 0x7fb2b8150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 -- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b80ad960 msgr2=0x7fb2b8154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b80ad960 0x7fb2b8154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2b7e00640 1 -- 172.21.15.42:0/412607294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009390 con 0x7fb2b80add30 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.373+0000 7fb2bce00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b80ad960 0x7fb2b8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.374+0000 7fb2b7e00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 0x7fb2b8150590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4035040 tx=0x7fb2a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.374+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4031de0 con 0x7fb2b80add30 2024-08-17T02:27:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.374+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a403e450 con 0x7fb2b80add30 2024-08-17T02:27:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.374+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a403e850 con 0x7fb2b80add30 2024-08-17T02:27:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.374+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b81513a0 con 0x7fb2b80add30 2024-08-17T02:27:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.374+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b81581d0 con 0x7fb2b80add30 2024-08-17T02:27:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.375+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8158760 con 0x7fb2b80add30 2024-08-17T02:27:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.376+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb2a403c400 con 0x7fb2b80add30 2024-08-17T02:27:26.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.377+0000 7fb2abe00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb298065150 0x7fb298067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.377+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2a40a2c90 con 0x7fb2b80add30 2024-08-17T02:27:26.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.377+0000 7fb2bce00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb298065150 0x7fb298067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.377+0000 7fb2bce00640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb298065150 0x7fb298067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac006fd0 tx=0x7fb2ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.381+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb2b8158760 con 0x7fb2b80add30 2024-08-17T02:27:26.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:26.612+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb2b8063fb0 con 0x7fb2b80add30 2024-08-17T02:27:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.445+0000 7fb2abe00640 1 -- 172.21.15.42:0/412607294 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb2a40370b0 con 0x7fb2b80add30 2024-08-17T02:27:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb298065150 msgr2=0x7fb298067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb298065150 0x7fb298067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac006fd0 tx=0x7fb2ac008040 comp rx=0 tx=0).stop 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 msgr2=0x7fb2b8150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 0x7fb2b8150590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4035040 tx=0x7fb2a4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 shutdown_connections 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb298065150 0x7fb298067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2b80ca050 0x7fb2b8150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2b80add30 0x7fb2b8150590 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 --2- 172.21.15.42:0/412607294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2b80ad960 0x7fb2b8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 >> 172.21.15.42:0/412607294 conn(0x7fb2b8066e60 msgr2=0x7fb2b815a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 shutdown_connections 2024-08-17T02:27:27.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.448+0000 7fb2bf800640 1 -- 172.21.15.42:0/412607294 wait complete. 2024-08-17T02:27:27.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:27:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.623+0000 7f2485800640 1 Processor -- start 2024-08-17T02:27:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.623+0000 7f2485800640 1 -- start start 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2485800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24800b1850 0x7f24800b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2485800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24800d0650 0x7f24800ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2485800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800ce9b0 con 0x7f24801585a0 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2485800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24800cec90 con 0x7f24800b1850 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2485800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24800cef70 con 0x7f24800d0650 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f247fe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24800b1850 0x7f24800b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2484e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f24801585a0 0x7f24801589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37344/0 (socket says 172.21.15.42:37344) 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f2484e00640 1 -- 172.21.15.42:0/2463923344 learned_addr learned my addr 172.21.15.42:0/2463923344 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f247f400640 1 --2- 172.21.15.42:0/2463923344 >> v2:172.21.15.62:3300/0 conn(0x7f24800d0650 0x7f24800ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f247fe00640 1 -- 172.21.15.42:0/2463923344 >> v2:172.21.15.62:3300/0 conn(0x7f24800d0650 msgr2=0x7f24800ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f247fe00640 1 --2- 172.21.15.42:0/2463923344 >> v2:172.21.15.62:3300/0 conn(0x7f24800d0650 0x7f24800ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f247fe00640 1 -- 172.21.15.42:0/2463923344 >> v1:172.21.15.42:6789/0 conn(0x7f24801585a0 legacy=0x7f24801589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.626+0000 7f247fe00640 1 -- 172.21.15.42:0/2463923344 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24800cf250 con 0x7f24800b1850 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f247fe00640 1 --2- 172.21.15.42:0/2463923344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800b1850 0x7f24800b1c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24800699a0 tx=0x7f24700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c2be8e25d07851 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f247ea00640 1 -- 172.21.15.42:0/2463923344 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247002adb0 con 0x7f24800b1850 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f247ea00640 1 -- 172.21.15.42:0/2463923344 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470032440 con 0x7f24800b1850 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f247ea00640 1 -- 172.21.15.42:0/2463923344 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470032820 con 0x7f24800b1850 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f2485800640 1 -- 172.21.15.42:0/2463923344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800b1850 msgr2=0x7f24800b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f2485800640 1 --2- 172.21.15.42:0/2463923344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800b1850 0x7f24800b1c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24800699a0 tx=0x7f24700090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f2485800640 1 -- 172.21.15.42:0/2463923344 shutdown_connections 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f2485800640 1 --2- 172.21.15.42:0/2463923344 >> v2:172.21.15.62:3300/0 conn(0x7f24800d0650 0x7f24800ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f2485800640 1 --2- 172.21.15.42:0/2463923344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800b1850 0x7f24800b1c20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.627+0000 7f2485800640 1 -- 172.21.15.42:0/2463923344 >> 172.21.15.42:0/2463923344 conn(0x7f248006e590 msgr2=0x7f248006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.628+0000 7f2485800640 1 -- 172.21.15.42:0/2463923344 shutdown_connections 2024-08-17T02:27:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.628+0000 7f2485800640 1 -- 172.21.15.42:0/2463923344 wait complete. 2024-08-17T02:27:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.629+0000 7f2485800640 1 Processor -- start 2024-08-17T02:27:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.629+0000 7f2485800640 1 -- start start 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24800b1850 0x7f2480169d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 0x7f24801530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24801585a0 0x7f2480166500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800ab580 con 0x7f24800d0650 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480153610 con 0x7f24800b1850 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800ab710 con 0x7f24801585a0 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 0x7f24801530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 0x7f24801530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47838/0 (socket says 172.21.15.42:47838) 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 -- 172.21.15.42:0/1970845470 learned_addr learned my addr 172.21.15.42:0/1970845470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247fe00640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24800b1850 0x7f2480169d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2484e00640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24801585a0 0x7f2480166500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 -- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24801585a0 msgr2=0x7f2480166500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24801585a0 0x7f2480166500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 -- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24800b1850 msgr2=0x7f2480169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24800b1850 0x7f2480169d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 -- 172.21.15.42:0/1970845470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2470009390 con 0x7f24800d0650 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2484e00640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24801585a0 0x7f2480166500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247fe00640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24800b1850 0x7f2480169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f247f400640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 0x7f24801530d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f246c00d890 tx=0x7f246c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00de20 con 0x7f24800d0650 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c00b870 con 0x7f24800d0650 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00bc10 con 0x7f24800d0650 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2480153850 con 0x7f24800d0650 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.631+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24801540f0 con 0x7f24800d0650 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.632+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2480070720 con 0x7f24800d0650 2024-08-17T02:27:27.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.633+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f246c01e460 con 0x7f24800d0650 2024-08-17T02:27:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.634+0000 7f2477400640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2460065250 0x7f2460067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.634+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f246c082a30 con 0x7f24800d0650 2024-08-17T02:27:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.634+0000 7f247fe00640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2460065250 0x7f2460067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.634+0000 7f247fe00640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2460065250 0x7f2460067700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2470034000 tx=0x7f2470032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.638+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f246c050b90 con 0x7f24800d0650 2024-08-17T02:27:27.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:27.860+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f24800ab850 con 0x7f24800d0650 2024-08-17T02:27:28.169 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-08-17T02:27:28.168+0000 7f0162800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.446+0000 7f2477400640 1 -- 172.21.15.42:0/1970845470 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f246c0541b0 con 0x7f24800d0650 2024-08-17T02:27:28.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2460065250 msgr2=0x7f2460067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2460065250 0x7f2460067700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2470034000 tx=0x7f2470032000 comp rx=0 tx=0).stop 2024-08-17T02:27:28.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 msgr2=0x7f24801530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 0x7f24801530d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f246c00d890 tx=0x7f246c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:28.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 shutdown_connections 2024-08-17T02:27:28.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2460065250 0x7f2460067700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f24801585a0 0x7f2480166500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24800d0650 0x7f24801530d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 --2- 172.21.15.42:0/1970845470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24800b1850 0x7f2480169d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 >> 172.21.15.42:0/1970845470 conn(0x7f248006e590 msgr2=0x7f24800ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 shutdown_connections 2024-08-17T02:27:28.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.449+0000 7f2485800640 1 -- 172.21.15.42:0/1970845470 wait complete. 2024-08-17T02:27:28.492 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:28.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.646+0000 7fbe91600640 1 Processor -- start 2024-08-17T02:27:28.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.646+0000 7fbe91600640 1 -- start start 2024-08-17T02:27:28.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe91600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe8c158d50 0x7fbe8c0ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe91600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c159120 0x7fbe8c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe91600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe8c0ac9e0 0x7fbe8c0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe91600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0a96c0 con 0x7fbe8c0ac9e0 2024-08-17T02:27:28.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe91600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0acf00 con 0x7fbe8c158d50 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe91600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0af7d0 con 0x7fbe8c159120 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe8c0ac9e0 0x7fbe8c0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe8c0ac9e0 0x7fbe8c0abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47844/0 (socket says 172.21.15.42:47844) 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 -- 172.21.15.42:0/3796005989 learned_addr learned my addr 172.21.15.42:0/3796005989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8aa00640 1 --2- 172.21.15.42:0/3796005989 >> v2:172.21.15.62:3300/0 conn(0x7fbe8c158d50 0x7fbe8c0ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8a000640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c159120 0x7fbe8c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 -- 172.21.15.42:0/3796005989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c159120 msgr2=0x7fbe8c0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c159120 0x7fbe8c0ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 -- 172.21.15.42:0/3796005989 >> v2:172.21.15.62:3300/0 conn(0x7fbe8c158d50 msgr2=0x7fbe8c0ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 --2- 172.21.15.42:0/3796005989 >> v2:172.21.15.62:3300/0 conn(0x7fbe8c158d50 0x7fbe8c0ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8b400640 1 -- 172.21.15.42:0/3796005989 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0a98f0 con 0x7fbe8c0ac9e0 2024-08-17T02:27:28.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.648+0000 7fbe8a000640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c159120 0x7fbe8c0ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe8b400640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c0ac9e0 0x7fbe8c0abe30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06ecf0 tx=0x7fbe84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cdf1aa9234df62 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe89600640 1 -- 172.21.15.42:0/3796005989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84031400 con 0x7fbe8c0ac9e0 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe89600640 1 -- 172.21.15.42:0/3796005989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8402d050 con 0x7fbe8c0ac9e0 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe89600640 1 -- 172.21.15.42:0/3796005989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe840317d0 con 0x7fbe8c0ac9e0 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 -- 172.21.15.42:0/3796005989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c0ac9e0 msgr2=0x7fbe8c0abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c0ac9e0 0x7fbe8c0abe30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c06ecf0 tx=0x7fbe84009840 comp rx=0 tx=0).stop 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 -- 172.21.15.42:0/3796005989 shutdown_connections 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c0ac9e0 0x7fbe8c0abe30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 --2- 172.21.15.42:0/3796005989 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c159120 0x7fbe8c0ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 --2- 172.21.15.42:0/3796005989 >> v2:172.21.15.62:3300/0 conn(0x7fbe8c158d50 0x7fbe8c0ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 -- 172.21.15.42:0/3796005989 >> 172.21.15.42:0/3796005989 conn(0x7fbe8c095a70 msgr2=0x7fbe8c095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 -- 172.21.15.42:0/3796005989 shutdown_connections 2024-08-17T02:27:28.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.650+0000 7fbe91600640 1 -- 172.21.15.42:0/3796005989 wait complete. 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.651+0000 7fbe91600640 1 Processor -- start 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 -- start start 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c0ac9e0 0x7fbe8c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 0x7fbe8c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe8c159120 0x7fbe8c169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c154df0 con 0x7fbe8c158d50 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c155420 con 0x7fbe8c159120 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.652+0000 7fbe91600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c15ac40 con 0x7fbe8c0ac9e0 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 0x7fbe8c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 0x7fbe8c0b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47850/0 (socket says 172.21.15.42:47850) 2024-08-17T02:27:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 -- 172.21.15.42:0/2326548356 learned_addr learned my addr 172.21.15.42:0/2326548356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c0ac9e0 0x7fbe8c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8b400640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe8c159120 0x7fbe8c169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 -- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c0ac9e0 msgr2=0x7fbe8c1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c0ac9e0 0x7fbe8c1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 -- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe8c159120 msgr2=0x7fbe8c169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe8c159120 0x7fbe8c169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 -- 172.21.15.42:0/2326548356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe84009ae0 con 0x7fbe8c158d50 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.653+0000 7fbe8a000640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 0x7fbe8c0b10a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800d890 tx=0x7fbe78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.654+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800de80 con 0x7fbe8c158d50 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.654+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7800b960 con 0x7fbe8c158d50 2024-08-17T02:27:28.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.654+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800bce0 con 0x7fbe8c158d50 2024-08-17T02:27:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.654+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c15af20 con 0x7fbe8c158d50 2024-08-17T02:27:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.654+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c155950 con 0x7fbe8c158d50 2024-08-17T02:27:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.655+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c063fb0 con 0x7fbe8c158d50 2024-08-17T02:27:28.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.655+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe78014640 con 0x7fbe8c158d50 2024-08-17T02:27:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.656+0000 7fbe82000640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe6c065150 0x7fbe6c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.656+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe78082af0 con 0x7fbe8c158d50 2024-08-17T02:27:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.657+0000 7fbe8aa00640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe6c065150 0x7fbe6c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.657+0000 7fbe8aa00640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe6c065150 0x7fbe6c067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009c80 tx=0x7fbe7c0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.660+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbe78050bc0 con 0x7fbe8c158d50 2024-08-17T02:27:28.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.879+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe8c155ae0 con 0x7fbe8c158d50 2024-08-17T02:27:28.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.879+0000 7fbe82000640 1 -- 172.21.15.42:0/2326548356 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fbe780541e0 con 0x7fbe8c158d50 2024-08-17T02:27:28.881 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:28.881 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:28.881 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:27:28.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe6c065150 msgr2=0x7fbe6c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe6c065150 0x7fbe6c067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009c80 tx=0x7fbe7c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 msgr2=0x7fbe8c0b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 0x7fbe8c0b10a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800d890 tx=0x7fbe78008040 comp rx=0 tx=0).stop 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 shutdown_connections 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe6c065150 0x7fbe6c067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe8c159120 0x7fbe8c169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe8c158d50 0x7fbe8c0b10a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 --2- 172.21.15.42:0/2326548356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe8c0ac9e0 0x7fbe8c1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 >> 172.21.15.42:0/2326548356 conn(0x7fbe8c095a70 msgr2=0x7fbe8c0ab2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.881+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 shutdown_connections 2024-08-17T02:27:28.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:28.882+0000 7fbe91600640 1 -- 172.21.15.42:0/2326548356 wait complete. 2024-08-17T02:27:28.898 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:29.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.048+0000 7ff88d000640 1 Processor -- start 2024-08-17T02:27:29.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.048+0000 7ff88d000640 1 -- start start 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.048+0000 7ff88d000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff8880afca0 0x7ff8880b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff88d000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880c92b0 con 0x7ff8881590b0 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff88d000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880ad480 con 0x7ff8880acf10 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff88d000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880b0980 con 0x7ff8880afca0 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff885e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff8880afca0 0x7ff8880b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff886800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff8881590b0 0x7ff8880c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37360/0 (socket says 172.21.15.42:37360) 2024-08-17T02:27:29.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff886800640 1 -- 172.21.15.42:0/1566143188 learned_addr learned my addr 172.21.15.42:0/1566143188 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff885e00640 1 -- 172.21.15.42:0/1566143188 >> v1:172.21.15.62:6789/0 conn(0x7ff8880acf10 legacy=0x7ff8881589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff885e00640 1 -- 172.21.15.42:0/1566143188 >> v1:172.21.15.42:6789/0 conn(0x7ff8881590b0 legacy=0x7ff8880c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff885400640 1 -- 172.21.15.42:0/1566143188 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68365877 0 0) 0x7ff8880c92b0 con 0x7ff8881590b0 2024-08-17T02:27:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.049+0000 7ff885e00640 1 -- 172.21.15.42:0/1566143188 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880ad760 con 0x7ff8880afca0 2024-08-17T02:27:29.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.050+0000 7ff885e00640 1 --2- 172.21.15.42:0/1566143188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff8880b0070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff878009850 tx=0x7ff8780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3ead02d2a9ab30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.050+0000 7ff885400640 1 -- 172.21.15.42:0/1566143188 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87802ae20 con 0x7ff8880afca0 2024-08-17T02:27:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.050+0000 7ff885400640 1 -- 172.21.15.42:0/1566143188 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff878032440 con 0x7ff8880afca0 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff885400640 1 -- 172.21.15.42:0/1566143188 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780327e0 con 0x7ff8880afca0 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 -- 172.21.15.42:0/1566143188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 msgr2=0x7ff8880b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 --2- 172.21.15.42:0/1566143188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff8880b0070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff878009850 tx=0x7ff8780090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 -- 172.21.15.42:0/1566143188 shutdown_connections 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 --2- 172.21.15.42:0/1566143188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff8880b0070 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 -- 172.21.15.42:0/1566143188 >> 172.21.15.42:0/1566143188 conn(0x7ff888066e60 msgr2=0x7ff888067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 -- 172.21.15.42:0/1566143188 shutdown_connections 2024-08-17T02:27:29.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.051+0000 7ff88d000640 1 -- 172.21.15.42:0/1566143188 wait complete. 2024-08-17T02:27:29.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.052+0000 7ff88d000640 1 Processor -- start 2024-08-17T02:27:29.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 -- start start 2024-08-17T02:27:29.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8880acf10 0x7ff88813cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff88814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8881590b0 0x7ff88813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88816c450 con 0x7ff8880afca0 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888146fa0 con 0x7ff8881590b0 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.053+0000 7ff88d000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88813d1d0 con 0x7ff8880acf10 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff88814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff88814a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47856/0 (socket says 172.21.15.42:47856) 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 -- 172.21.15.42:0/4091988293 learned_addr learned my addr 172.21.15.42:0/4091988293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff885e00640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8880acf10 0x7ff88813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff886800640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8881590b0 0x7ff88813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 -- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8880acf10 msgr2=0x7ff88813cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8880acf10 0x7ff88813cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 -- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8881590b0 msgr2=0x7ff88813f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8881590b0 0x7ff88813f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.054+0000 7ff87fe00640 1 -- 172.21.15.42:0/4091988293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009390 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.055+0000 7ff87fe00640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff88814a920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c590 tx=0x7ff870007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.055+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870012630 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.055+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8700127b0 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.055+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870012b70 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.055+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff888146390 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.055+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff888146950 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.056+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888063fb0 con 0x7ff8880afca0 2024-08-17T02:27:29.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.057+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff87001b400 con 0x7ff8880afca0 2024-08-17T02:27:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.057+0000 7ff87d600640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff864065150 0x7ff864067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.057+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff870081ee0 con 0x7ff8880afca0 2024-08-17T02:27:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.058+0000 7ff885e00640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff864065150 0x7ff864067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.058+0000 7ff885e00640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff864065150 0x7ff864067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff878034000 tx=0x7ff878032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.062+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff87004ffb0 con 0x7ff8880afca0 2024-08-17T02:27:29.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.244+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff888067b70 con 0x7ff8880afca0 2024-08-17T02:27:29.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.245+0000 7ff87d600640 1 -- 172.21.15.42:0/4091988293 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7ff8700535d0 con 0x7ff8880afca0 2024-08-17T02:27:29.246 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:29.246 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:29.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff864065150 msgr2=0x7ff864067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff864065150 0x7ff864067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff878034000 tx=0x7ff878032000 comp rx=0 tx=0).stop 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 msgr2=0x7ff88814a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff88814a920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c590 tx=0x7ff870007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 shutdown_connections 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff864065150 0x7ff864067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8881590b0 0x7ff88813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8880afca0 0x7ff88814a920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 --2- 172.21.15.42:0/4091988293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8880acf10 0x7ff88813cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 >> 172.21.15.42:0/4091988293 conn(0x7ff888066e60 msgr2=0x7ff888158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 shutdown_connections 2024-08-17T02:27:29.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.247+0000 7ff88d000640 1 -- 172.21.15.42:0/4091988293 wait complete. 2024-08-17T02:27:29.263 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:29.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:29.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.414+0000 7f555c200640 1 Processor -- start 2024-08-17T02:27:29.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.414+0000 7f555c200640 1 -- start start 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f555c200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f55541590b0 0x7f55540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f555c200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f55540acf10 0x7f5554159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f555c200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555415a4e0 con 0x7f55540afca0 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f555c200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55540b0980 con 0x7f55541590b0 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f555c200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55540c92b0 con 0x7f55540acf10 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5559800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f55540afca0 0x7f55541589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37364/0 (socket says 172.21.15.42:37364) 2024-08-17T02:27:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5559800640 1 -- 172.21.15.42:0/4240630675 learned_addr learned my addr 172.21.15.42:0/4240630675 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5558e00640 1 --2- 172.21.15.42:0/4240630675 >> v2:172.21.15.42:3300/0 conn(0x7f55541590b0 0x7f55540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f555a200640 1 --2- 172.21.15.42:0/4240630675 >> v2:172.21.15.62:3300/0 conn(0x7f55540acf10 0x7f5554159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5553e00640 1 -- 172.21.15.42:0/4240630675 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765850464 0 0) 0x7f5548001110 con 0x7f55540afca0 2024-08-17T02:27:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5553e00640 1 -- 172.21.15.42:0/4240630675 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f553c0034e0 con 0x7f55540afca0 2024-08-17T02:27:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5558e00640 1 -- 172.21.15.42:0/4240630675 >> v2:172.21.15.62:3300/0 conn(0x7f55540acf10 msgr2=0x7f5554159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5558e00640 1 --2- 172.21.15.42:0/4240630675 >> v2:172.21.15.62:3300/0 conn(0x7f55540acf10 0x7f5554159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5558e00640 1 -- 172.21.15.42:0/4240630675 >> v1:172.21.15.42:6789/0 conn(0x7f55540afca0 legacy=0x7f55541589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.416+0000 7f5558e00640 1 -- 172.21.15.42:0/4240630675 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55540ad480 con 0x7f55541590b0 2024-08-17T02:27:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.417+0000 7f5558e00640 1 --2- 172.21.15.42:0/4240630675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f55540b0070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f55540cb4a0 tx=0x7f55400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7892aaa3e7f64d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f5553e00640 1 -- 172.21.15.42:0/4240630675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554002adb0 con 0x7f55541590b0 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f5553e00640 1 -- 172.21.15.42:0/4240630675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540032440 con 0x7f55541590b0 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f5553e00640 1 -- 172.21.15.42:0/4240630675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540032820 con 0x7f55541590b0 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 -- 172.21.15.42:0/4240630675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 msgr2=0x7f55540b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 --2- 172.21.15.42:0/4240630675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f55540b0070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f55540cb4a0 tx=0x7f55400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 -- 172.21.15.42:0/4240630675 shutdown_connections 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 --2- 172.21.15.42:0/4240630675 >> v2:172.21.15.62:3300/0 conn(0x7f55540acf10 0x7f5554159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 --2- 172.21.15.42:0/4240630675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f55540b0070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 -- 172.21.15.42:0/4240630675 >> 172.21.15.42:0/4240630675 conn(0x7f5554066e60 msgr2=0x7f5554067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 -- 172.21.15.42:0/4240630675 shutdown_connections 2024-08-17T02:27:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.418+0000 7f555c200640 1 -- 172.21.15.42:0/4240630675 wait complete. 2024-08-17T02:27:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.420+0000 7f555c200640 1 Processor -- start 2024-08-17T02:27:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.420+0000 7f555c200640 1 -- start start 2024-08-17T02:27:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555c200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55540acf10 0x7f555414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555c200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55540afca0 0x7f555406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555c200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f555406af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555c200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5554155150 con 0x7f55541590b0 2024-08-17T02:27:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555c200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5554155410 con 0x7f55540afca0 2024-08-17T02:27:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555c200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555414e9d0 con 0x7f55540acf10 2024-08-17T02:27:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f555406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f555406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47868/0 (socket says 172.21.15.42:47868) 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 -- 172.21.15.42:0/1011668705 learned_addr learned my addr 172.21.15.42:0/1011668705 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f5558e00640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55540afca0 0x7f555406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f5559800640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55540acf10 0x7f555414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 -- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55540acf10 msgr2=0x7f555414c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55540acf10 0x7f555414c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 -- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55540afca0 msgr2=0x7f555406a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.421+0000 7f555a200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55540afca0 0x7f555406a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f555a200640 1 -- 172.21.15.42:0/1011668705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009390 con 0x7f55541590b0 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f555a200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f555406af10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f554c009df0 tx=0x7f554c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00cd40 con 0x7f55541590b0 2024-08-17T02:27:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00f040 con 0x7f55541590b0 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0146d0 con 0x7f55541590b0 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555414ecb0 con 0x7f55541590b0 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.422+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555414f270 con 0x7f55541590b0 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.423+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5554155580 con 0x7f55541590b0 2024-08-17T02:27:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.424+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f554c014a80 con 0x7f55541590b0 2024-08-17T02:27:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.425+0000 7f5550c00640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5534065150 0x7f5534067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.425+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f554c082df0 con 0x7f55541590b0 2024-08-17T02:27:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.425+0000 7f5559800640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5534065150 0x7f5534067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.426+0000 7f5559800640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5534065150 0x7f5534067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5548001270 tx=0x7f5548007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.429+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f554c050ec0 con 0x7f55541590b0 2024-08-17T02:27:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.613+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5554063fb0 con 0x7f5534065150 2024-08-17T02:27:29.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.622+0000 7f5550c00640 1 -- 172.21.15.42:0/1011668705 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7f5554063fb0 con 0x7f5534065150 2024-08-17T02:27:29.625 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:29.626 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5534065150 msgr2=0x7f5534067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5534065150 0x7f5534067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5548001270 tx=0x7f5548007b60 comp rx=0 tx=0).stop 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 msgr2=0x7f555406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f555406af10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f554c009df0 tx=0x7f554c00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 shutdown_connections 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5534065150 0x7f5534067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55541590b0 0x7f555406af10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55540afca0 0x7f555406a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.626+0000 7f555c200640 1 --2- 172.21.15.42:0/1011668705 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f55540acf10 0x7f555414c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.627+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 >> 172.21.15.42:0/1011668705 conn(0x7f5554066e60 msgr2=0x7f55540c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.627+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 shutdown_connections 2024-08-17T02:27:29.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.627+0000 7f555c200640 1 -- 172.21.15.42:0/1011668705 wait complete. 2024-08-17T02:27:29.643 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:27:29.183649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398644,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576076,"statfs":{"total":773094113280,"available":770637901824,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.767971"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461874+0000","last_change":"2024-08-17T02:27:25.455330+0000","last_active":"2024-08-17T02:27:25.461874+0000","last_peered":"2024-08-17T02:27:25.461874+0000","last_clean":"2024-08-17T02:27:25.461874+0000","last_became_active":"2024-08-17T02:27:25.455125+0000","last_became_peered":"2024-08-17T02:27:25.455125+0000","last_unstale":"2024-08-17T02:27:25.461874+0000","last_undegraded":"2024-08-17T02:27:25.461874+0000","last_fullsized":"2024-08-17T02:27:25.461874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459752+0000","last_change":"2024-08-17T02:27:25.453226+0000","last_active":"2024-08-17T02:27:25.459752+0000","last_peered":"2024-08-17T02:27:25.459752+0000","last_clean":"2024-08-17T02:27:25.459752+0000","last_became_active":"2024-08-17T02:27:25.452935+0000","last_became_peered":"2024-08-17T02:27:25.452935+0000","last_unstale":"2024-08-17T02:27:25.459752+0000","last_undegraded":"2024-08-17T02:27:25.459752+0000","last_fullsized":"2024-08-17T02:27:25.459752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455153+0000","last_change":"2024-08-17T02:27:25.446924+0000","last_active":"2024-08-17T02:27:25.455153+0000","last_peered":"2024-08-17T02:27:25.455153+0000","last_clean":"2024-08-17T02:27:25.455153+0000","last_became_active":"2024-08-17T02:27:25.446221+0000","last_became_peered":"2024-08-17T02:27:25.446221+0000","last_unstale":"2024-08-17T02:27:25.455153+0000","last_undegraded":"2024-08-17T02:27:25.455153+0000","last_fullsized":"2024-08-17T02:27:25.455153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470821+0000","last_change":"2024-08-17T02:27:25.470009+0000","last_active":"2024-08-17T02:27:25.470821+0000","last_peered":"2024-08-17T02:27:25.470821+0000","last_clean":"2024-08-17T02:27:25.470821+0000","last_became_active":"2024-08-17T02:27:25.469648+0000","last_became_peered":"2024-08-17T02:27:25.469648+0000","last_unstale":"2024-08-17T02:27:25.470821+0000","last_undegraded":"2024-08-17T02:27:25.470821+0000","last_fullsized":"2024-08-17T02:27:25.470821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454890+0000","last_change":"2024-08-17T02:27:25.449603+0000","last_active":"2024-08-17T02:27:25.454890+0000","last_peered":"2024-08-17T02:27:25.454890+0000","last_clean":"2024-08-17T02:27:25.454890+0000","last_became_active":"2024-08-17T02:27:25.449260+0000","last_became_peered":"2024-08-17T02:27:25.449260+0000","last_unstale":"2024-08-17T02:27:25.454890+0000","last_undegraded":"2024-08-17T02:27:25.454890+0000","last_fullsized":"2024-08-17T02:27:25.454890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456632+0000","last_change":"2024-08-17T02:27:25.452008+0000","last_active":"2024-08-17T02:27:25.456632+0000","last_peered":"2024-08-17T02:27:25.456632+0000","last_clean":"2024-08-17T02:27:25.456632+0000","last_became_active":"2024-08-17T02:27:25.451745+0000","last_became_peered":"2024-08-17T02:27:25.451745+0000","last_unstale":"2024-08-17T02:27:25.456632+0000","last_undegraded":"2024-08-17T02:27:25.456632+0000","last_fullsized":"2024-08-17T02:27:25.456632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462102+0000","last_change":"2024-08-17T02:27:25.456866+0000","last_active":"2024-08-17T02:27:25.462102+0000","last_peered":"2024-08-17T02:27:25.462102+0000","last_clean":"2024-08-17T02:27:25.462102+0000","last_became_active":"2024-08-17T02:27:25.456558+0000","last_became_peered":"2024-08-17T02:27:25.456558+0000","last_unstale":"2024-08-17T02:27:25.462102+0000","last_undegraded":"2024-08-17T02:27:25.462102+0000","last_fullsized":"2024-08-17T02:27:25.462102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466556+0000","last_change":"2024-08-17T02:27:25.455754+0000","last_active":"2024-08-17T02:27:25.466556+0000","last_peered":"2024-08-17T02:27:25.466556+0000","last_clean":"2024-08-17T02:27:25.466556+0000","last_became_active":"2024-08-17T02:27:25.449947+0000","last_became_peered":"2024-08-17T02:27:25.449947+0000","last_unstale":"2024-08-17T02:27:25.466556+0000","last_undegraded":"2024-08-17T02:27:25.466556+0000","last_fullsized":"2024-08-17T02:27:25.466556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460668+0000","last_change":"2024-08-17T02:27:25.451824+0000","last_active":"2024-08-17T02:27:25.460668+0000","last_peered":"2024-08-17T02:27:25.460668+0000","last_clean":"2024-08-17T02:27:25.460668+0000","last_became_active":"2024-08-17T02:27:25.451484+0000","last_became_peered":"2024-08-17T02:27:25.451484+0000","last_unstale":"2024-08-17T02:27:25.460668+0000","last_undegraded":"2024-08-17T02:27:25.460668+0000","last_fullsized":"2024-08-17T02:27:25.460668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438873+0000","last_change":"2024-08-17T02:27:25.437579+0000","last_active":"2024-08-17T02:27:25.438873+0000","last_peered":"2024-08-17T02:27:25.438873+0000","last_clean":"2024-08-17T02:27:25.438873+0000","last_became_active":"2024-08-17T02:27:25.437293+0000","last_became_peered":"2024-08-17T02:27:25.437293+0000","last_unstale":"2024-08-17T02:27:25.438873+0000","last_undegraded":"2024-08-17T02:27:25.438873+0000","last_fullsized":"2024-08-17T02:27:25.438873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451016+0000","last_change":"2024-08-17T02:27:25.439072+0000","last_active":"2024-08-17T02:27:25.451016+0000","last_peered":"2024-08-17T02:27:25.451016+0000","last_clean":"2024-08-17T02:27:25.451016+0000","last_became_active":"2024-08-17T02:27:25.438775+0000","last_became_peered":"2024-08-17T02:27:25.438775+0000","last_unstale":"2024-08-17T02:27:25.451016+0000","last_undegraded":"2024-08-17T02:27:25.451016+0000","last_fullsized":"2024-08-17T02:27:25.451016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441975+0000","last_change":"2024-08-17T02:27:25.435276+0000","last_active":"2024-08-17T02:27:25.441975+0000","last_peered":"2024-08-17T02:27:25.441975+0000","last_clean":"2024-08-17T02:27:25.441975+0000","last_became_active":"2024-08-17T02:27:25.433425+0000","last_became_peered":"2024-08-17T02:27:25.433425+0000","last_unstale":"2024-08-17T02:27:25.441975+0000","last_undegraded":"2024-08-17T02:27:25.441975+0000","last_fullsized":"2024-08-17T02:27:25.441975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461122+0000","last_change":"2024-08-17T02:27:25.441556+0000","last_active":"2024-08-17T02:27:25.461122+0000","last_peered":"2024-08-17T02:27:25.461122+0000","last_clean":"2024-08-17T02:27:25.461122+0000","last_became_active":"2024-08-17T02:27:25.441313+0000","last_became_peered":"2024-08-17T02:27:25.441313+0000","last_unstale":"2024-08-17T02:27:25.461122+0000","last_undegraded":"2024-08-17T02:27:25.461122+0000","last_fullsized":"2024-08-17T02:27:25.461122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454910+0000","last_change":"2024-08-17T02:27:25.450943+0000","last_active":"2024-08-17T02:27:25.454910+0000","last_peered":"2024-08-17T02:27:25.454910+0000","last_clean":"2024-08-17T02:27:25.454910+0000","last_became_active":"2024-08-17T02:27:25.449195+0000","last_became_peered":"2024-08-17T02:27:25.449195+0000","last_unstale":"2024-08-17T02:27:25.454910+0000","last_undegraded":"2024-08-17T02:27:25.454910+0000","last_fullsized":"2024-08-17T02:27:25.454910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439145+0000","last_change":"2024-08-17T02:27:25.436204+0000","last_active":"2024-08-17T02:27:25.439145+0000","last_peered":"2024-08-17T02:27:25.439145+0000","last_clean":"2024-08-17T02:27:25.439145+0000","last_became_active":"2024-08-17T02:27:25.435925+0000","last_became_peered":"2024-08-17T02:27:25.435925+0000","last_unstale":"2024-08-17T02:27:25.439145+0000","last_undegraded":"2024-08-17T02:27:25.439145+0000","last_fullsized":"2024-08-17T02:27:25.439145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456664+0000","last_change":"2024-08-17T02:27:25.452597+0000","last_active":"2024-08-17T02:27:25.456664+0000","last_peered":"2024-08-17T02:27:25.456664+0000","last_clean":"2024-08-17T02:27:25.456664+0000","last_became_active":"2024-08-17T02:27:25.452396+0000","last_became_peered":"2024-08-17T02:27:25.452396+0000","last_unstale":"2024-08-17T02:27:25.456664+0000","last_undegraded":"2024-08-17T02:27:25.456664+0000","last_fullsized":"2024-08-17T02:27:25.456664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451355+0000","last_change":"2024-08-17T02:27:25.448186+0000","last_active":"2024-08-17T02:27:25.451355+0000","last_peered":"2024-08-17T02:27:25.451355+0000","last_clean":"2024-08-17T02:27:25.451355+0000","last_became_active":"2024-08-17T02:27:25.446348+0000","last_became_peered":"2024-08-17T02:27:25.446348+0000","last_unstale":"2024-08-17T02:27:25.451355+0000","last_undegraded":"2024-08-17T02:27:25.451355+0000","last_fullsized":"2024-08-17T02:27:25.451355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446526+0000","last_change":"2024-08-17T02:27:25.440779+0000","last_active":"2024-08-17T02:27:25.446526+0000","last_peered":"2024-08-17T02:27:25.446526+0000","last_clean":"2024-08-17T02:27:25.446526+0000","last_became_active":"2024-08-17T02:27:25.440337+0000","last_became_peered":"2024-08-17T02:27:25.440337+0000","last_unstale":"2024-08-17T02:27:25.446526+0000","last_undegraded":"2024-08-17T02:27:25.446526+0000","last_fullsized":"2024-08-17T02:27:25.446526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456529+0000","last_change":"2024-08-17T02:27:25.449909+0000","last_active":"2024-08-17T02:27:25.456529+0000","last_peered":"2024-08-17T02:27:25.456529+0000","last_clean":"2024-08-17T02:27:25.456529+0000","last_became_active":"2024-08-17T02:27:25.449657+0000","last_became_peered":"2024-08-17T02:27:25.449657+0000","last_unstale":"2024-08-17T02:27:25.456529+0000","last_undegraded":"2024-08-17T02:27:25.456529+0000","last_fullsized":"2024-08-17T02:27:25.456529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451092+0000","last_change":"2024-08-17T02:27:25.439755+0000","last_active":"2024-08-17T02:27:25.451092+0000","last_peered":"2024-08-17T02:27:25.451092+0000","last_clean":"2024-08-17T02:27:25.451092+0000","last_became_active":"2024-08-17T02:27:25.439512+0000","last_became_peered":"2024-08-17T02:27:25.439512+0000","last_unstale":"2024-08-17T02:27:25.451092+0000","last_undegraded":"2024-08-17T02:27:25.451092+0000","last_fullsized":"2024-08-17T02:27:25.451092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451164+0000","last_change":"2024-08-17T02:27:25.445422+0000","last_active":"2024-08-17T02:27:25.451164+0000","last_peered":"2024-08-17T02:27:25.451164+0000","last_clean":"2024-08-17T02:27:25.451164+0000","last_became_active":"2024-08-17T02:27:25.445153+0000","last_became_peered":"2024-08-17T02:27:25.445153+0000","last_unstale":"2024-08-17T02:27:25.451164+0000","last_undegraded":"2024-08-17T02:27:25.451164+0000","last_fullsized":"2024-08-17T02:27:25.451164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450548+0000","last_change":"2024-08-17T02:27:25.445499+0000","last_active":"2024-08-17T02:27:25.450548+0000","last_peered":"2024-08-17T02:27:25.450548+0000","last_clean":"2024-08-17T02:27:25.450548+0000","last_became_active":"2024-08-17T02:27:25.445127+0000","last_became_peered":"2024-08-17T02:27:25.445127+0000","last_unstale":"2024-08-17T02:27:25.450548+0000","last_undegraded":"2024-08-17T02:27:25.450548+0000","last_fullsized":"2024-08-17T02:27:25.450548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466499+0000","last_change":"2024-08-17T02:27:25.460811+0000","last_active":"2024-08-17T02:27:25.466499+0000","last_peered":"2024-08-17T02:27:25.466499+0000","last_clean":"2024-08-17T02:27:25.466499+0000","last_became_active":"2024-08-17T02:27:25.460513+0000","last_became_peered":"2024-08-17T02:27:25.460513+0000","last_unstale":"2024-08-17T02:27:25.466499+0000","last_undegraded":"2024-08-17T02:27:25.466499+0000","last_fullsized":"2024-08-17T02:27:25.466499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468295+0000","last_change":"2024-08-17T02:27:25.466496+0000","last_active":"2024-08-17T02:27:25.468295+0000","last_peered":"2024-08-17T02:27:25.468295+0000","last_clean":"2024-08-17T02:27:25.468295+0000","last_became_active":"2024-08-17T02:27:25.466240+0000","last_became_peered":"2024-08-17T02:27:25.466240+0000","last_unstale":"2024-08-17T02:27:25.468295+0000","last_undegraded":"2024-08-17T02:27:25.468295+0000","last_fullsized":"2024-08-17T02:27:25.468295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467606+0000","last_change":"2024-08-17T02:27:25.461454+0000","last_active":"2024-08-17T02:27:25.467606+0000","last_peered":"2024-08-17T02:27:25.467606+0000","last_clean":"2024-08-17T02:27:25.467606+0000","last_became_active":"2024-08-17T02:27:25.460585+0000","last_became_peered":"2024-08-17T02:27:25.460585+0000","last_unstale":"2024-08-17T02:27:25.467606+0000","last_undegraded":"2024-08-17T02:27:25.467606+0000","last_fullsized":"2024-08-17T02:27:25.467606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.452006+0000","last_change":"2024-08-17T02:27:25.440879+0000","last_active":"2024-08-17T02:27:25.452006+0000","last_peered":"2024-08-17T02:27:25.452006+0000","last_clean":"2024-08-17T02:27:25.452006+0000","last_became_active":"2024-08-17T02:27:25.440638+0000","last_became_peered":"2024-08-17T02:27:25.440638+0000","last_unstale":"2024-08-17T02:27:25.452006+0000","last_undegraded":"2024-08-17T02:27:25.452006+0000","last_fullsized":"2024-08-17T02:27:25.452006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465682+0000","last_change":"2024-08-17T02:27:25.463971+0000","last_active":"2024-08-17T02:27:25.465682+0000","last_peered":"2024-08-17T02:27:25.465682+0000","last_clean":"2024-08-17T02:27:25.465682+0000","last_became_active":"2024-08-17T02:27:25.463657+0000","last_became_peered":"2024-08-17T02:27:25.463657+0000","last_unstale":"2024-08-17T02:27:25.465682+0000","last_undegraded":"2024-08-17T02:27:25.465682+0000","last_fullsized":"2024-08-17T02:27:25.465682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465530+0000","last_change":"2024-08-17T02:27:25.450808+0000","last_active":"2024-08-17T02:27:25.465530+0000","last_peered":"2024-08-17T02:27:25.465530+0000","last_clean":"2024-08-17T02:27:25.465530+0000","last_became_active":"2024-08-17T02:27:25.450474+0000","last_became_peered":"2024-08-17T02:27:25.450474+0000","last_unstale":"2024-08-17T02:27:25.465530+0000","last_undegraded":"2024-08-17T02:27:25.465530+0000","last_fullsized":"2024-08-17T02:27:25.465530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464102+0000","last_change":"2024-08-17T02:27:25.462561+0000","last_active":"2024-08-17T02:27:25.464102+0000","last_peered":"2024-08-17T02:27:25.464102+0000","last_clean":"2024-08-17T02:27:25.464102+0000","last_became_active":"2024-08-17T02:27:25.462314+0000","last_became_peered":"2024-08-17T02:27:25.462314+0000","last_unstale":"2024-08-17T02:27:25.464102+0000","last_undegraded":"2024-08-17T02:27:25.464102+0000","last_fullsized":"2024-08-17T02:27:25.464102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:55.384786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468210+0000","last_change":"2024-08-17T02:27:25.465776+0000","last_active":"2024-08-17T02:27:25.468210+0000","last_peered":"2024-08-17T02:27:25.468210+0000","last_clean":"2024-08-17T02:27:25.468210+0000","last_became_active":"2024-08-17T02:27:25.465517+0000","last_became_peered":"2024-08-17T02:27:25.465517+0000","last_unstale":"2024-08-17T02:27:25.468210+0000","last_undegraded":"2024-08-17T02:27:25.468210+0000","last_fullsized":"2024-08-17T02:27:25.468210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446395+0000","last_change":"2024-08-17T02:27:25.436230+0000","last_active":"2024-08-17T02:27:25.446395+0000","last_peered":"2024-08-17T02:27:25.446395+0000","last_clean":"2024-08-17T02:27:25.446395+0000","last_became_active":"2024-08-17T02:27:25.435981+0000","last_became_peered":"2024-08-17T02:27:25.435981+0000","last_unstale":"2024-08-17T02:27:25.446395+0000","last_undegraded":"2024-08-17T02:27:25.446395+0000","last_fullsized":"2024-08-17T02:27:25.446395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455807+0000","last_change":"2024-08-17T02:27:25.453066+0000","last_active":"2024-08-17T02:27:25.455807+0000","last_peered":"2024-08-17T02:27:25.455807+0000","last_clean":"2024-08-17T02:27:25.455807+0000","last_became_active":"2024-08-17T02:27:25.452821+0000","last_became_peered":"2024-08-17T02:27:25.452821+0000","last_unstale":"2024-08-17T02:27:25.455807+0000","last_undegraded":"2024-08-17T02:27:25.455807+0000","last_fullsized":"2024-08-17T02:27:25.455807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:07:02.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441899+0000","last_change":"2024-08-17T02:27:25.430552+0000","last_active":"2024-08-17T02:27:25.441899+0000","last_peered":"2024-08-17T02:27:25.441899+0000","last_clean":"2024-08-17T02:27:25.441899+0000","last_became_active":"2024-08-17T02:27:25.429351+0000","last_became_peered":"2024-08-17T02:27:25.429351+0000","last_unstale":"2024-08-17T02:27:25.441899+0000","last_undegraded":"2024-08-17T02:27:25.441899+0000","last_fullsized":"2024-08-17T02:27:25.441899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:57.515905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470407+0000","last_change":"2024-08-17T02:27:24.450643+0000","last_active":"2024-08-17T02:27:25.470407+0000","last_peered":"2024-08-17T02:27:25.470407+0000","last_clean":"2024-08-17T02:27:25.470407+0000","last_became_active":"2024-08-17T02:27:24.450201+0000","last_became_peered":"2024-08-17T02:27:24.450201+0000","last_unstale":"2024-08-17T02:27:25.470407+0000","last_undegraded":"2024-08-17T02:27:25.470407+0000","last_fullsized":"2024-08-17T02:27:25.470407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451185+0000","last_change":"2024-08-17T02:27:25.445553+0000","last_active":"2024-08-17T02:27:25.451185+0000","last_peered":"2024-08-17T02:27:25.451185+0000","last_clean":"2024-08-17T02:27:25.451185+0000","last_became_active":"2024-08-17T02:27:25.445275+0000","last_became_peered":"2024-08-17T02:27:25.445275+0000","last_unstale":"2024-08-17T02:27:25.451185+0000","last_undegraded":"2024-08-17T02:27:25.451185+0000","last_fullsized":"2024-08-17T02:27:25.451185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461254+0000","last_change":"2024-08-17T02:27:24.439165+0000","last_active":"2024-08-17T02:27:25.461254+0000","last_peered":"2024-08-17T02:27:25.461254+0000","last_clean":"2024-08-17T02:27:25.461254+0000","last_became_active":"2024-08-17T02:27:24.437397+0000","last_became_peered":"2024-08-17T02:27:24.437397+0000","last_unstale":"2024-08-17T02:27:25.461254+0000","last_undegraded":"2024-08-17T02:27:25.461254+0000","last_fullsized":"2024-08-17T02:27:25.461254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.429962+0000","last_change":"2024-08-17T02:27:24.445238+0000","last_active":"2024-08-17T02:27:25.429962+0000","last_peered":"2024-08-17T02:27:25.429962+0000","last_clean":"2024-08-17T02:27:25.429962+0000","last_became_active":"2024-08-17T02:27:24.444156+0000","last_became_peered":"2024-08-17T02:27:24.444156+0000","last_unstale":"2024-08-17T02:27:25.429962+0000","last_undegraded":"2024-08-17T02:27:25.429962+0000","last_fullsized":"2024-08-17T02:27:25.429962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466566+0000","last_change":"2024-08-17T02:27:25.456302+0000","last_active":"2024-08-17T02:27:25.466566+0000","last_peered":"2024-08-17T02:27:25.466566+0000","last_clean":"2024-08-17T02:27:25.466566+0000","last_became_active":"2024-08-17T02:27:25.456006+0000","last_became_peered":"2024-08-17T02:27:25.456006+0000","last_unstale":"2024-08-17T02:27:25.466566+0000","last_undegraded":"2024-08-17T02:27:25.466566+0000","last_fullsized":"2024-08-17T02:27:25.466566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.430567+0000","last_change":"2024-08-17T02:27:24.442260+0000","last_active":"2024-08-17T02:27:25.430567+0000","last_peered":"2024-08-17T02:27:25.430567+0000","last_clean":"2024-08-17T02:27:25.430567+0000","last_became_active":"2024-08-17T02:27:24.440158+0000","last_became_peered":"2024-08-17T02:27:24.440158+0000","last_unstale":"2024-08-17T02:27:25.430567+0000","last_undegraded":"2024-08-17T02:27:25.430567+0000","last_fullsized":"2024-08-17T02:27:25.430567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.442431+0000","last_change":"2024-08-17T02:27:25.439235+0000","last_active":"2024-08-17T02:27:25.442431+0000","last_peered":"2024-08-17T02:27:25.442431+0000","last_clean":"2024-08-17T02:27:25.442431+0000","last_became_active":"2024-08-17T02:27:25.438932+0000","last_became_peered":"2024-08-17T02:27:25.438932+0000","last_unstale":"2024-08-17T02:27:25.442431+0000","last_undegraded":"2024-08-17T02:27:25.442431+0000","last_fullsized":"2024-08-17T02:27:25.442431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.426017+0000","last_change":"2024-08-17T02:27:24.439888+0000","last_active":"2024-08-17T02:27:25.426017+0000","last_peered":"2024-08-17T02:27:25.426017+0000","last_clean":"2024-08-17T02:27:25.426017+0000","last_became_active":"2024-08-17T02:27:24.439256+0000","last_became_peered":"2024-08-17T02:27:24.439256+0000","last_unstale":"2024-08-17T02:27:25.426017+0000","last_undegraded":"2024-08-17T02:27:25.426017+0000","last_fullsized":"2024-08-17T02:27:25.426017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450765+0000","last_change":"2024-08-17T02:27:25.445654+0000","last_active":"2024-08-17T02:27:25.450765+0000","last_peered":"2024-08-17T02:27:25.450765+0000","last_clean":"2024-08-17T02:27:25.450765+0000","last_became_active":"2024-08-17T02:27:25.445315+0000","last_became_peered":"2024-08-17T02:27:25.445315+0000","last_unstale":"2024-08-17T02:27:25.450765+0000","last_undegraded":"2024-08-17T02:27:25.450765+0000","last_fullsized":"2024-08-17T02:27:25.450765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431851+0000","last_change":"2024-08-17T02:27:24.439678+0000","last_active":"2024-08-17T02:27:25.431851+0000","last_peered":"2024-08-17T02:27:25.431851+0000","last_clean":"2024-08-17T02:27:25.431851+0000","last_became_active":"2024-08-17T02:27:24.438827+0000","last_became_peered":"2024-08-17T02:27:24.438827+0000","last_unstale":"2024-08-17T02:27:25.431851+0000","last_undegraded":"2024-08-17T02:27:25.431851+0000","last_fullsized":"2024-08-17T02:27:25.431851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453338+0000","last_change":"2024-08-17T02:27:25.446818+0000","last_active":"2024-08-17T02:27:25.453338+0000","last_peered":"2024-08-17T02:27:25.453338+0000","last_clean":"2024-08-17T02:27:25.453338+0000","last_became_active":"2024-08-17T02:27:25.446160+0000","last_became_peered":"2024-08-17T02:27:25.446160+0000","last_unstale":"2024-08-17T02:27:25.453338+0000","last_undegraded":"2024-08-17T02:27:25.453338+0000","last_fullsized":"2024-08-17T02:27:25.453338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461740+0000","last_change":"2024-08-17T02:27:24.444574+0000","last_active":"2024-08-17T02:27:25.461740+0000","last_peered":"2024-08-17T02:27:25.461740+0000","last_clean":"2024-08-17T02:27:25.461740+0000","last_became_active":"2024-08-17T02:27:24.444333+0000","last_became_peered":"2024-08-17T02:27:24.444333+0000","last_unstale":"2024-08-17T02:27:25.461740+0000","last_undegraded":"2024-08-17T02:27:25.461740+0000","last_fullsized":"2024-08-17T02:27:25.461740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457512+0000","last_change":"2024-08-17T02:27:25.444360+0000","last_active":"2024-08-17T02:27:25.457512+0000","last_peered":"2024-08-17T02:27:25.457512+0000","last_clean":"2024-08-17T02:27:25.457512+0000","last_became_active":"2024-08-17T02:27:25.444106+0000","last_became_peered":"2024-08-17T02:27:25.444106+0000","last_unstale":"2024-08-17T02:27:25.457512+0000","last_undegraded":"2024-08-17T02:27:25.457512+0000","last_fullsized":"2024-08-17T02:27:25.457512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:43.203136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.472906+0000","last_change":"2024-08-17T02:27:24.445437+0000","last_active":"2024-08-17T02:27:25.472906+0000","last_peered":"2024-08-17T02:27:25.472906+0000","last_clean":"2024-08-17T02:27:25.472906+0000","last_became_active":"2024-08-17T02:27:24.445008+0000","last_became_peered":"2024-08-17T02:27:24.445008+0000","last_unstale":"2024-08-17T02:27:25.472906+0000","last_undegraded":"2024-08-17T02:27:25.472906+0000","last_fullsized":"2024-08-17T02:27:25.472906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462054+0000","last_change":"2024-08-17T02:27:25.456825+0000","last_active":"2024-08-17T02:27:25.462054+0000","last_peered":"2024-08-17T02:27:25.462054+0000","last_clean":"2024-08-17T02:27:25.462054+0000","last_became_active":"2024-08-17T02:27:25.456323+0000","last_became_peered":"2024-08-17T02:27:25.456323+0000","last_unstale":"2024-08-17T02:27:25.462054+0000","last_undegraded":"2024-08-17T02:27:25.462054+0000","last_fullsized":"2024-08-17T02:27:25.462054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464743+0000","last_change":"2024-08-17T02:27:24.438473+0000","last_active":"2024-08-17T02:27:25.464743+0000","last_peered":"2024-08-17T02:27:25.464743+0000","last_clean":"2024-08-17T02:27:25.464743+0000","last_became_active":"2024-08-17T02:27:24.438205+0000","last_became_peered":"2024-08-17T02:27:24.438205+0000","last_unstale":"2024-08-17T02:27:25.464743+0000","last_undegraded":"2024-08-17T02:27:25.464743+0000","last_fullsized":"2024-08-17T02:27:25.464743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:56.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454929+0000","last_change":"2024-08-17T02:27:25.451195+0000","last_active":"2024-08-17T02:27:25.454929+0000","last_peered":"2024-08-17T02:27:25.454929+0000","last_clean":"2024-08-17T02:27:25.454929+0000","last_became_active":"2024-08-17T02:27:25.444332+0000","last_became_peered":"2024-08-17T02:27:25.444332+0000","last_unstale":"2024-08-17T02:27:25.454929+0000","last_undegraded":"2024-08-17T02:27:25.454929+0000","last_fullsized":"2024-08-17T02:27:25.454929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431434+0000","last_change":"2024-08-17T02:27:24.444612+0000","last_active":"2024-08-17T02:27:25.431434+0000","last_peered":"2024-08-17T02:27:25.431434+0000","last_clean":"2024-08-17T02:27:25.431434+0000","last_became_active":"2024-08-17T02:27:24.444307+0000","last_became_peered":"2024-08-17T02:27:24.444307+0000","last_unstale":"2024-08-17T02:27:25.431434+0000","last_undegraded":"2024-08-17T02:27:25.431434+0000","last_fullsized":"2024-08-17T02:27:25.431434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462196+0000","last_change":"2024-08-17T02:27:25.458229+0000","last_active":"2024-08-17T02:27:25.462196+0000","last_peered":"2024-08-17T02:27:25.462196+0000","last_clean":"2024-08-17T02:27:25.462196+0000","last_became_active":"2024-08-17T02:27:25.457949+0000","last_became_peered":"2024-08-17T02:27:25.457949+0000","last_unstale":"2024-08-17T02:27:25.462196+0000","last_undegraded":"2024-08-17T02:27:25.462196+0000","last_fullsized":"2024-08-17T02:27:25.462196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425557+0000","last_change":"2024-08-17T02:27:24.435541+0000","last_active":"2024-08-17T02:27:25.425557+0000","last_peered":"2024-08-17T02:27:25.425557+0000","last_clean":"2024-08-17T02:27:25.425557+0000","last_became_active":"2024-08-17T02:27:24.435267+0000","last_became_peered":"2024-08-17T02:27:24.435267+0000","last_unstale":"2024-08-17T02:27:25.425557+0000","last_undegraded":"2024-08-17T02:27:25.425557+0000","last_fullsized":"2024-08-17T02:27:25.425557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453321+0000","last_change":"2024-08-17T02:27:25.442847+0000","last_active":"2024-08-17T02:27:25.453321+0000","last_peered":"2024-08-17T02:27:25.453321+0000","last_clean":"2024-08-17T02:27:25.453321+0000","last_became_active":"2024-08-17T02:27:25.442470+0000","last_became_peered":"2024-08-17T02:27:25.442470+0000","last_unstale":"2024-08-17T02:27:25.453321+0000","last_undegraded":"2024-08-17T02:27:25.453321+0000","last_fullsized":"2024-08-17T02:27:25.453321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:50.390710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464153+0000","last_change":"2024-08-17T02:27:24.437545+0000","last_active":"2024-08-17T02:27:25.464153+0000","last_peered":"2024-08-17T02:27:25.464153+0000","last_clean":"2024-08-17T02:27:25.464153+0000","last_became_active":"2024-08-17T02:27:24.437177+0000","last_became_peered":"2024-08-17T02:27:24.437177+0000","last_unstale":"2024-08-17T02:27:25.464153+0000","last_undegraded":"2024-08-17T02:27:25.464153+0000","last_fullsized":"2024-08-17T02:27:25.464153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462291+0000","last_change":"2024-08-17T02:27:25.458884+0000","last_active":"2024-08-17T02:27:25.462291+0000","last_peered":"2024-08-17T02:27:25.462291+0000","last_clean":"2024-08-17T02:27:25.462291+0000","last_became_active":"2024-08-17T02:27:25.458541+0000","last_became_peered":"2024-08-17T02:27:25.458541+0000","last_unstale":"2024-08-17T02:27:25.462291+0000","last_undegraded":"2024-08-17T02:27:25.462291+0000","last_fullsized":"2024-08-17T02:27:25.462291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461445+0000","last_change":"2024-08-17T02:27:24.438345+0000","last_active":"2024-08-17T02:27:25.461445+0000","last_peered":"2024-08-17T02:27:25.461445+0000","last_clean":"2024-08-17T02:27:25.461445+0000","last_became_active":"2024-08-17T02:27:24.438014+0000","last_became_peered":"2024-08-17T02:27:24.438014+0000","last_unstale":"2024-08-17T02:27:25.461445+0000","last_undegraded":"2024-08-17T02:27:25.461445+0000","last_fullsized":"2024-08-17T02:27:25.461445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:51.236659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460458+0000","last_change":"2024-08-17T02:27:25.451119+0000","last_active":"2024-08-17T02:27:25.460458+0000","last_peered":"2024-08-17T02:27:25.460458+0000","last_clean":"2024-08-17T02:27:25.460458+0000","last_became_active":"2024-08-17T02:27:25.450850+0000","last_became_peered":"2024-08-17T02:27:25.450850+0000","last_unstale":"2024-08-17T02:27:25.460458+0000","last_undegraded":"2024-08-17T02:27:25.460458+0000","last_fullsized":"2024-08-17T02:27:25.460458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466776+0000","last_change":"2024-08-17T02:27:24.448256+0000","last_active":"2024-08-17T02:27:25.466776+0000","last_peered":"2024-08-17T02:27:25.466776+0000","last_clean":"2024-08-17T02:27:25.466776+0000","last_became_active":"2024-08-17T02:27:24.447922+0000","last_became_peered":"2024-08-17T02:27:24.447922+0000","last_unstale":"2024-08-17T02:27:25.466776+0000","last_undegraded":"2024-08-17T02:27:25.466776+0000","last_fullsized":"2024-08-17T02:27:25.466776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462323+0000","last_change":"2024-08-17T02:27:25.458937+0000","last_active":"2024-08-17T02:27:25.462323+0000","last_peered":"2024-08-17T02:27:25.462323+0000","last_clean":"2024-08-17T02:27:25.462323+0000","last_became_active":"2024-08-17T02:27:25.458689+0000","last_became_peered":"2024-08-17T02:27:25.458689+0000","last_unstale":"2024-08-17T02:27:25.462323+0000","last_undegraded":"2024-08-17T02:27:25.462323+0000","last_fullsized":"2024-08-17T02:27:25.462323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461606+0000","last_change":"2024-08-17T02:27:24.436502+0000","last_active":"2024-08-17T02:27:25.461606+0000","last_peered":"2024-08-17T02:27:25.461606+0000","last_clean":"2024-08-17T02:27:25.461606+0000","last_became_active":"2024-08-17T02:27:24.435360+0000","last_became_peered":"2024-08-17T02:27:24.435360+0000","last_unstale":"2024-08-17T02:27:25.461606+0000","last_undegraded":"2024-08-17T02:27:25.461606+0000","last_fullsized":"2024-08-17T02:27:25.461606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467392+0000","last_change":"2024-08-17T02:27:25.465732+0000","last_active":"2024-08-17T02:27:25.467392+0000","last_peered":"2024-08-17T02:27:25.467392+0000","last_clean":"2024-08-17T02:27:25.467392+0000","last_became_active":"2024-08-17T02:27:25.465477+0000","last_became_peered":"2024-08-17T02:27:25.465477+0000","last_unstale":"2024-08-17T02:27:25.467392+0000","last_undegraded":"2024-08-17T02:27:25.467392+0000","last_fullsized":"2024-08-17T02:27:25.467392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.436763+0000","last_change":"2024-08-17T02:27:24.447436+0000","last_active":"2024-08-17T02:27:25.436763+0000","last_peered":"2024-08-17T02:27:25.436763+0000","last_clean":"2024-08-17T02:27:25.436763+0000","last_became_active":"2024-08-17T02:27:24.446567+0000","last_became_peered":"2024-08-17T02:27:24.446567+0000","last_unstale":"2024-08-17T02:27:25.436763+0000","last_undegraded":"2024-08-17T02:27:25.436763+0000","last_fullsized":"2024-08-17T02:27:25.436763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461787+0000","last_change":"2024-08-17T02:27:25.453401+0000","last_active":"2024-08-17T02:27:25.461787+0000","last_peered":"2024-08-17T02:27:25.461787+0000","last_clean":"2024-08-17T02:27:25.461787+0000","last_became_active":"2024-08-17T02:27:25.453012+0000","last_became_peered":"2024-08-17T02:27:25.453012+0000","last_unstale":"2024-08-17T02:27:25.461787+0000","last_undegraded":"2024-08-17T02:27:25.461787+0000","last_fullsized":"2024-08-17T02:27:25.461787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434221+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:27:25.434221+0000","last_peered":"2024-08-17T02:27:25.434221+0000","last_clean":"2024-08-17T02:27:25.434221+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:27:25.434221+0000","last_undegraded":"2024-08-17T02:27:25.434221+0000","last_fullsized":"2024-08-17T02:27:25.434221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.428317+0000","last_change":"2024-08-17T02:27:24.434655+0000","last_active":"2024-08-17T02:27:25.428317+0000","last_peered":"2024-08-17T02:27:25.428317+0000","last_clean":"2024-08-17T02:27:25.428317+0000","last_became_active":"2024-08-17T02:27:24.434310+0000","last_became_peered":"2024-08-17T02:27:24.434310+0000","last_unstale":"2024-08-17T02:27:25.428317+0000","last_undegraded":"2024-08-17T02:27:25.428317+0000","last_fullsized":"2024-08-17T02:27:25.428317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460185+0000","last_change":"2024-08-17T02:27:25.447580+0000","last_active":"2024-08-17T02:27:25.460185+0000","last_peered":"2024-08-17T02:27:25.460185+0000","last_clean":"2024-08-17T02:27:25.460185+0000","last_became_active":"2024-08-17T02:27:25.447348+0000","last_became_peered":"2024-08-17T02:27:25.447348+0000","last_unstale":"2024-08-17T02:27:25.460185+0000","last_undegraded":"2024-08-17T02:27:25.460185+0000","last_fullsized":"2024-08-17T02:27:25.460185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434137+0000","last_change":"2024-08-17T02:27:24.449181+0000","last_active":"2024-08-17T02:27:25.434137+0000","last_peered":"2024-08-17T02:27:25.434137+0000","last_clean":"2024-08-17T02:27:25.434137+0000","last_became_active":"2024-08-17T02:27:24.448621+0000","last_became_peered":"2024-08-17T02:27:24.448621+0000","last_unstale":"2024-08-17T02:27:25.434137+0000","last_undegraded":"2024-08-17T02:27:25.434137+0000","last_fullsized":"2024-08-17T02:27:25.434137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455088+0000","last_change":"2024-08-17T02:27:25.451371+0000","last_active":"2024-08-17T02:27:25.455088+0000","last_peered":"2024-08-17T02:27:25.455088+0000","last_clean":"2024-08-17T02:27:25.455088+0000","last_became_active":"2024-08-17T02:27:25.451050+0000","last_became_peered":"2024-08-17T02:27:25.451050+0000","last_unstale":"2024-08-17T02:27:25.455088+0000","last_undegraded":"2024-08-17T02:27:25.455088+0000","last_fullsized":"2024-08-17T02:27:25.455088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431977+0000","last_change":"2024-08-17T02:27:24.445048+0000","last_active":"2024-08-17T02:27:25.431977+0000","last_peered":"2024-08-17T02:27:25.431977+0000","last_clean":"2024-08-17T02:27:25.431977+0000","last_became_active":"2024-08-17T02:27:24.444710+0000","last_became_peered":"2024-08-17T02:27:24.444710+0000","last_unstale":"2024-08-17T02:27:25.431977+0000","last_undegraded":"2024-08-17T02:27:25.431977+0000","last_fullsized":"2024-08-17T02:27:25.431977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.444039+0000","last_change":"2024-08-17T02:27:25.440656+0000","last_active":"2024-08-17T02:27:25.444039+0000","last_peered":"2024-08-17T02:27:25.444039+0000","last_clean":"2024-08-17T02:27:25.444039+0000","last_became_active":"2024-08-17T02:27:25.440321+0000","last_became_peered":"2024-08-17T02:27:25.440321+0000","last_unstale":"2024-08-17T02:27:25.444039+0000","last_undegraded":"2024-08-17T02:27:25.444039+0000","last_fullsized":"2024-08-17T02:27:25.444039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431535+0000","last_change":"2024-08-17T02:27:24.437523+0000","last_active":"2024-08-17T02:27:25.431535+0000","last_peered":"2024-08-17T02:27:25.431535+0000","last_clean":"2024-08-17T02:27:25.431535+0000","last_became_active":"2024-08-17T02:27:24.437285+0000","last_became_peered":"2024-08-17T02:27:24.437285+0000","last_unstale":"2024-08-17T02:27:25.431535+0000","last_undegraded":"2024-08-17T02:27:25.431535+0000","last_fullsized":"2024-08-17T02:27:25.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459340+0000","last_change":"2024-08-17T02:27:25.449648+0000","last_active":"2024-08-17T02:27:25.459340+0000","last_peered":"2024-08-17T02:27:25.459340+0000","last_clean":"2024-08-17T02:27:25.459340+0000","last_became_active":"2024-08-17T02:27:25.447084+0000","last_became_peered":"2024-08-17T02:27:25.447084+0000","last_unstale":"2024-08-17T02:27:25.459340+0000","last_undegraded":"2024-08-17T02:27:25.459340+0000","last_fullsized":"2024-08-17T02:27:25.459340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425327+0000","last_change":"2024-08-17T02:27:24.437263+0000","last_active":"2024-08-17T02:27:25.425327+0000","last_peered":"2024-08-17T02:27:25.425327+0000","last_clean":"2024-08-17T02:27:25.425327+0000","last_became_active":"2024-08-17T02:27:24.436992+0000","last_became_peered":"2024-08-17T02:27:24.436992+0000","last_unstale":"2024-08-17T02:27:25.425327+0000","last_undegraded":"2024-08-17T02:27:25.425327+0000","last_fullsized":"2024-08-17T02:27:25.425327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468312+0000","last_change":"2024-08-17T02:27:25.466345+0000","last_active":"2024-08-17T02:27:25.468312+0000","last_peered":"2024-08-17T02:27:25.468312+0000","last_clean":"2024-08-17T02:27:25.468312+0000","last_became_active":"2024-08-17T02:27:25.466038+0000","last_became_peered":"2024-08-17T02:27:25.466038+0000","last_unstale":"2024-08-17T02:27:25.468312+0000","last_undegraded":"2024-08-17T02:27:25.468312+0000","last_fullsized":"2024-08-17T02:27:25.468312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438148+0000","last_change":"2024-08-17T02:27:24.449902+0000","last_active":"2024-08-17T02:27:25.438148+0000","last_peered":"2024-08-17T02:27:25.438148+0000","last_clean":"2024-08-17T02:27:25.438148+0000","last_became_active":"2024-08-17T02:27:24.449525+0000","last_became_peered":"2024-08-17T02:27:24.449525+0000","last_unstale":"2024-08-17T02:27:25.438148+0000","last_undegraded":"2024-08-17T02:27:25.438148+0000","last_fullsized":"2024-08-17T02:27:25.438148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.445653+0000","last_change":"2024-08-17T02:27:25.440529+0000","last_active":"2024-08-17T02:27:25.445653+0000","last_peered":"2024-08-17T02:27:25.445653+0000","last_clean":"2024-08-17T02:27:25.445653+0000","last_became_active":"2024-08-17T02:27:25.440188+0000","last_became_peered":"2024-08-17T02:27:25.440188+0000","last_unstale":"2024-08-17T02:27:25.445653+0000","last_undegraded":"2024-08-17T02:27:25.445653+0000","last_fullsized":"2024-08-17T02:27:25.445653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:26.541464+0000","last_change":"2024-08-17T02:27:24.435826+0000","last_active":"2024-08-17T02:27:26.541464+0000","last_peered":"2024-08-17T02:27:26.541464+0000","last_clean":"2024-08-17T02:27:26.541464+0000","last_became_active":"2024-08-17T02:27:24.435410+0000","last_became_peered":"2024-08-17T02:27:24.435410+0000","last_unstale":"2024-08-17T02:27:26.541464+0000","last_undegraded":"2024-08-17T02:27:26.541464+0000","last_fullsized":"2024-08-17T02:27:26.541464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460275+0000","last_change":"2024-08-17T02:27:25.456094+0000","last_active":"2024-08-17T02:27:25.460275+0000","last_peered":"2024-08-17T02:27:25.460275+0000","last_clean":"2024-08-17T02:27:25.460275+0000","last_became_active":"2024-08-17T02:27:25.454642+0000","last_became_peered":"2024-08-17T02:27:25.454642+0000","last_unstale":"2024-08-17T02:27:25.460275+0000","last_undegraded":"2024-08-17T02:27:25.460275+0000","last_fullsized":"2024-08-17T02:27:25.460275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464709+0000","last_change":"2024-08-17T02:27:24.452692+0000","last_active":"2024-08-17T02:27:25.464709+0000","last_peered":"2024-08-17T02:27:25.464709+0000","last_clean":"2024-08-17T02:27:25.464709+0000","last_became_active":"2024-08-17T02:27:24.452303+0000","last_became_peered":"2024-08-17T02:27:24.452303+0000","last_unstale":"2024-08-17T02:27:25.464709+0000","last_undegraded":"2024-08-17T02:27:25.464709+0000","last_fullsized":"2024-08-17T02:27:25.464709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457334+0000","last_change":"2024-08-17T02:27:25.450938+0000","last_active":"2024-08-17T02:27:25.457334+0000","last_peered":"2024-08-17T02:27:25.457334+0000","last_clean":"2024-08-17T02:27:25.457334+0000","last_became_active":"2024-08-17T02:27:25.442137+0000","last_became_peered":"2024-08-17T02:27:25.442137+0000","last_unstale":"2024-08-17T02:27:25.457334+0000","last_undegraded":"2024-08-17T02:27:25.457334+0000","last_fullsized":"2024-08-17T02:27:25.457334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434024+0000","last_change":"2024-08-17T02:27:24.447388+0000","last_active":"2024-08-17T02:27:25.434024+0000","last_peered":"2024-08-17T02:27:25.434024+0000","last_clean":"2024-08-17T02:27:25.434024+0000","last_became_active":"2024-08-17T02:27:24.447000+0000","last_became_peered":"2024-08-17T02:27:24.447000+0000","last_unstale":"2024-08-17T02:27:25.434024+0000","last_undegraded":"2024-08-17T02:27:25.434024+0000","last_fullsized":"2024-08-17T02:27:25.434024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.458050+0000","last_change":"2024-08-17T02:27:25.448457+0000","last_active":"2024-08-17T02:27:25.458050+0000","last_peered":"2024-08-17T02:27:25.458050+0000","last_clean":"2024-08-17T02:27:25.458050+0000","last_became_active":"2024-08-17T02:27:25.441769+0000","last_became_peered":"2024-08-17T02:27:25.441769+0000","last_unstale":"2024-08-17T02:27:25.458050+0000","last_undegraded":"2024-08-17T02:27:25.458050+0000","last_fullsized":"2024-08-17T02:27:25.458050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424675+0000","last_change":"2024-08-17T02:27:24.443925+0000","last_active":"2024-08-17T02:27:25.424675+0000","last_peered":"2024-08-17T02:27:25.424675+0000","last_clean":"2024-08-17T02:27:25.424675+0000","last_became_active":"2024-08-17T02:27:24.443608+0000","last_became_peered":"2024-08-17T02:27:24.443608+0000","last_unstale":"2024-08-17T02:27:25.424675+0000","last_undegraded":"2024-08-17T02:27:25.424675+0000","last_fullsized":"2024-08-17T02:27:25.424675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467733+0000","last_change":"2024-08-17T02:27:25.462228+0000","last_active":"2024-08-17T02:27:25.467733+0000","last_peered":"2024-08-17T02:27:25.467733+0000","last_clean":"2024-08-17T02:27:25.467733+0000","last_became_active":"2024-08-17T02:27:25.448840+0000","last_became_peered":"2024-08-17T02:27:25.448840+0000","last_unstale":"2024-08-17T02:27:25.467733+0000","last_undegraded":"2024-08-17T02:27:25.467733+0000","last_fullsized":"2024-08-17T02:27:25.467733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424091+0000","last_change":"2024-08-17T02:27:24.445306+0000","last_active":"2024-08-17T02:27:25.424091+0000","last_peered":"2024-08-17T02:27:25.424091+0000","last_clean":"2024-08-17T02:27:25.424091+0000","last_became_active":"2024-08-17T02:27:24.445012+0000","last_became_peered":"2024-08-17T02:27:24.445012+0000","last_unstale":"2024-08-17T02:27:25.424091+0000","last_undegraded":"2024-08-17T02:27:25.424091+0000","last_fullsized":"2024-08-17T02:27:25.424091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467550+0000","last_change":"2024-08-17T02:27:25.461234+0000","last_active":"2024-08-17T02:27:25.467550+0000","last_peered":"2024-08-17T02:27:25.467550+0000","last_clean":"2024-08-17T02:27:25.467550+0000","last_became_active":"2024-08-17T02:27:25.455041+0000","last_became_peered":"2024-08-17T02:27:25.455041+0000","last_unstale":"2024-08-17T02:27:25.467550+0000","last_undegraded":"2024-08-17T02:27:25.467550+0000","last_fullsized":"2024-08-17T02:27:25.467550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460395+0000","last_change":"2024-08-17T02:27:24.449904+0000","last_active":"2024-08-17T02:27:25.460395+0000","last_peered":"2024-08-17T02:27:25.460395+0000","last_clean":"2024-08-17T02:27:25.460395+0000","last_became_active":"2024-08-17T02:27:24.449492+0000","last_became_peered":"2024-08-17T02:27:24.449492+0000","last_unstale":"2024-08-17T02:27:25.460395+0000","last_undegraded":"2024-08-17T02:27:25.460395+0000","last_fullsized":"2024-08-17T02:27:25.460395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439656+0000","last_change":"2024-08-17T02:27:25.432877+0000","last_active":"2024-08-17T02:27:25.439656+0000","last_peered":"2024-08-17T02:27:25.439656+0000","last_clean":"2024-08-17T02:27:25.439656+0000","last_became_active":"2024-08-17T02:27:25.432587+0000","last_became_peered":"2024-08-17T02:27:25.432587+0000","last_unstale":"2024-08-17T02:27:25.439656+0000","last_undegraded":"2024-08-17T02:27:25.439656+0000","last_fullsized":"2024-08-17T02:27:25.439656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454969+0000","last_change":"2024-08-17T02:27:25.448549+0000","last_active":"2024-08-17T02:27:25.454969+0000","last_peered":"2024-08-17T02:27:25.454969+0000","last_clean":"2024-08-17T02:27:25.454969+0000","last_became_active":"2024-08-17T02:27:25.448001+0000","last_became_peered":"2024-08-17T02:27:25.448001+0000","last_unstale":"2024-08-17T02:27:25.454969+0000","last_undegraded":"2024-08-17T02:27:25.454969+0000","last_fullsized":"2024-08-17T02:27:25.454969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460460+0000","last_change":"2024-08-17T02:27:24.450947+0000","last_active":"2024-08-17T02:27:25.460460+0000","last_peered":"2024-08-17T02:27:25.460460+0000","last_clean":"2024-08-17T02:27:25.460460+0000","last_became_active":"2024-08-17T02:27:24.450649+0000","last_became_peered":"2024-08-17T02:27:24.450649+0000","last_unstale":"2024-08-17T02:27:25.460460+0000","last_undegraded":"2024-08-17T02:27:25.460460+0000","last_fullsized":"2024-08-17T02:27:25.460460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:33.132085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450998+0000","last_change":"2024-08-17T02:27:25.446668+0000","last_active":"2024-08-17T02:27:25.450998+0000","last_peered":"2024-08-17T02:27:25.450998+0000","last_clean":"2024-08-17T02:27:25.450998+0000","last_became_active":"2024-08-17T02:27:25.446347+0000","last_became_peered":"2024-08-17T02:27:25.446347+0000","last_unstale":"2024-08-17T02:27:25.450998+0000","last_undegraded":"2024-08-17T02:27:25.450998+0000","last_fullsized":"2024-08-17T02:27:25.450998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456596+0000","last_change":"2024-08-17T02:27:24.451135+0000","last_active":"2024-08-17T02:27:25.456596+0000","last_peered":"2024-08-17T02:27:25.456596+0000","last_clean":"2024-08-17T02:27:25.456596+0000","last_became_active":"2024-08-17T02:27:24.450804+0000","last_became_peered":"2024-08-17T02:27:24.450804+0000","last_unstale":"2024-08-17T02:27:25.456596+0000","last_undegraded":"2024-08-17T02:27:25.456596+0000","last_fullsized":"2024-08-17T02:27:25.456596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:51.057653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453406+0000","last_change":"2024-08-17T02:27:25.446961+0000","last_active":"2024-08-17T02:27:25.453406+0000","last_peered":"2024-08-17T02:27:25.453406+0000","last_clean":"2024-08-17T02:27:25.453406+0000","last_became_active":"2024-08-17T02:27:25.446547+0000","last_became_peered":"2024-08-17T02:27:25.446547+0000","last_unstale":"2024-08-17T02:27:25.453406+0000","last_undegraded":"2024-08-17T02:27:25.453406+0000","last_fullsized":"2024-08-17T02:27:25.453406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470520+0000","last_change":"2024-08-17T02:27:24.442678+0000","last_active":"2024-08-17T02:27:25.470520+0000","last_peered":"2024-08-17T02:27:25.470520+0000","last_clean":"2024-08-17T02:27:25.470520+0000","last_became_active":"2024-08-17T02:27:24.441192+0000","last_became_peered":"2024-08-17T02:27:24.441192+0000","last_unstale":"2024-08-17T02:27:25.470520+0000","last_undegraded":"2024-08-17T02:27:25.470520+0000","last_fullsized":"2024-08-17T02:27:25.470520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465734+0000","last_change":"2024-08-17T02:27:25.459255+0000","last_active":"2024-08-17T02:27:25.465734+0000","last_peered":"2024-08-17T02:27:25.465734+0000","last_clean":"2024-08-17T02:27:25.465734+0000","last_became_active":"2024-08-17T02:27:25.458944+0000","last_became_peered":"2024-08-17T02:27:25.458944+0000","last_unstale":"2024-08-17T02:27:25.465734+0000","last_undegraded":"2024-08-17T02:27:25.465734+0000","last_fullsized":"2024-08-17T02:27:25.465734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464782+0000","last_change":"2024-08-17T02:27:24.450686+0000","last_active":"2024-08-17T02:27:25.464782+0000","last_peered":"2024-08-17T02:27:25.464782+0000","last_clean":"2024-08-17T02:27:25.464782+0000","last_became_active":"2024-08-17T02:27:24.450410+0000","last_became_peered":"2024-08-17T02:27:24.450410+0000","last_unstale":"2024-08-17T02:27:25.464782+0000","last_undegraded":"2024-08-17T02:27:25.464782+0000","last_fullsized":"2024-08-17T02:27:25.464782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4649999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.964}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4610000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2649999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0019999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3250000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:29.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.834+0000 7fd1eec00640 1 Processor -- start 2024-08-17T02:27:29.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.834+0000 7fd1eec00640 1 -- start start 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1eec00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd1e81590b0 0x7fd1e80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1eec00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80c92b0 con 0x7fd1e80afca0 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1eec00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80ad480 con 0x7fd1e80acf10 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1eec00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80b0980 con 0x7fd1e81590b0 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1dfe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd1e81590b0 0x7fd1e80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1e7e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd1e80afca0 0x7fd1e81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37366/0 (socket says 172.21.15.42:37366) 2024-08-17T02:27:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1e7e00640 1 -- 172.21.15.42:0/3103628064 learned_addr learned my addr 172.21.15.42:0/3103628064 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1dfe00640 1 -- 172.21.15.42:0/3103628064 >> v1:172.21.15.62:6789/0 conn(0x7fd1e80acf10 legacy=0x7fd1e80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1dfe00640 1 -- 172.21.15.42:0/3103628064 >> v1:172.21.15.42:6789/0 conn(0x7fd1e80afca0 legacy=0x7fd1e81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1e7400640 1 -- 172.21.15.42:0/3103628064 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162962215 0 0) 0x7fd1e80c92b0 con 0x7fd1e80afca0 2024-08-17T02:27:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.836+0000 7fd1dfe00640 1 -- 172.21.15.42:0/3103628064 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80ad760 con 0x7fd1e81590b0 2024-08-17T02:27:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.837+0000 7fd1dfe00640 1 --2- 172.21.15.42:0/3103628064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e81590b0 0x7fd1e80b0070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000baf0 tx=0x7fd1d000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe298d2abb58ef2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1e7400640 1 -- 172.21.15.42:0/3103628064 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0032680 con 0x7fd1e81590b0 2024-08-17T02:27:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1e7400640 1 -- 172.21.15.42:0/3103628064 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00327e0 con 0x7fd1e81590b0 2024-08-17T02:27:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1e7400640 1 -- 172.21.15.42:0/3103628064 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0032b80 con 0x7fd1e81590b0 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 -- 172.21.15.42:0/3103628064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e81590b0 msgr2=0x7fd1e80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 --2- 172.21.15.42:0/3103628064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e81590b0 0x7fd1e80b0070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000baf0 tx=0x7fd1d000b3b0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 -- 172.21.15.42:0/3103628064 shutdown_connections 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 --2- 172.21.15.42:0/3103628064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e81590b0 0x7fd1e80b0070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 -- 172.21.15.42:0/3103628064 >> 172.21.15.42:0/3103628064 conn(0x7fd1e8066e60 msgr2=0x7fd1e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 -- 172.21.15.42:0/3103628064 shutdown_connections 2024-08-17T02:27:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.838+0000 7fd1eec00640 1 -- 172.21.15.42:0/3103628064 wait complete. 2024-08-17T02:27:29.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.840+0000 7fd1eec00640 1 Processor -- start 2024-08-17T02:27:29.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.840+0000 7fd1eec00640 1 -- start start 2024-08-17T02:27:29.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1eec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 0x7fd1e816c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1eec00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e80afca0 0x7fd1e81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1eec00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e81590b0 0x7fd1e81518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1eec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8155250 con 0x7fd1e80acf10 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1eec00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8154f50 con 0x7fd1e80afca0 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1eec00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e816cd60 con 0x7fd1e81590b0 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 0x7fd1e816c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 0x7fd1e816c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47878/0 (socket says 172.21.15.42:47878) 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 -- 172.21.15.42:0/2111040756 learned_addr learned my addr 172.21.15.42:0/2111040756 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1dfe00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e80afca0 0x7fd1e81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1ecc00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e81590b0 0x7fd1e81518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 -- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e81590b0 msgr2=0x7fd1e81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e81590b0 0x7fd1e81518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 -- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e80afca0 msgr2=0x7fd1e81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e80afca0 0x7fd1e81556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1e7e00640 1 -- 172.21.15.42:0/2111040756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d000b630 con 0x7fd1e80acf10 2024-08-17T02:27:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.841+0000 7fd1dfe00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e80afca0 0x7fd1e81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.842+0000 7fd1e7e00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 0x7fd1e816c510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c610 tx=0x7fd1d8007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.842+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8005aa0 con 0x7fd1e80acf10 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.842+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8005c00 con 0x7fd1e80acf10 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.842+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80070f0 con 0x7fd1e80acf10 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.842+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e816d040 con 0x7fd1e80acf10 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.842+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e8155c20 con 0x7fd1e80acf10 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.843+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8063fb0 con 0x7fd1e80acf10 2024-08-17T02:27:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.844+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd1d8007500 con 0x7fd1e80acf10 2024-08-17T02:27:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.845+0000 7fd1df400640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd1c4065220 0x7fd1c40676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.845+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1d8081d80 con 0x7fd1e80acf10 2024-08-17T02:27:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.845+0000 7fd1dfe00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd1c4065220 0x7fd1c40676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.846+0000 7fd1dfe00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd1c4065220 0x7fd1c40676d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0037000 tx=0x7fd1d003a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:29.848+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd1d804ffa0 con 0x7fd1e80acf10 2024-08-17T02:27:30.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.027+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1e8067b70 con 0x7fd1c4065220 2024-08-17T02:27:30.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.034+0000 7fd1df400640 1 -- 172.21.15.42:0/2111040756 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7fd1e8067b70 con 0x7fd1c4065220 2024-08-17T02:27:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:30.038 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:27:30.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd1c4065220 msgr2=0x7fd1c40676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd1c4065220 0x7fd1c40676d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0037000 tx=0x7fd1d003a000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 msgr2=0x7fd1e816c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 0x7fd1e816c510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c610 tx=0x7fd1d8007d00 comp rx=0 tx=0).stop 2024-08-17T02:27:30.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 shutdown_connections 2024-08-17T02:27:30.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd1c4065220 0x7fd1c40676d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd1e81590b0 0x7fd1e81518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1e80afca0 0x7fd1e81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 --2- 172.21.15.42:0/2111040756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1e80acf10 0x7fd1e816c510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 >> 172.21.15.42:0/2111040756 conn(0x7fd1e8066e60 msgr2=0x7fd1e80c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 shutdown_connections 2024-08-17T02:27:30.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.038+0000 7fd1eec00640 1 -- 172.21.15.42:0/2111040756 wait complete. 2024-08-17T02:27:30.052 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:27:29.183649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398644,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576076,"statfs":{"total":773094113280,"available":770637901824,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.767971"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461874+0000","last_change":"2024-08-17T02:27:25.455330+0000","last_active":"2024-08-17T02:27:25.461874+0000","last_peered":"2024-08-17T02:27:25.461874+0000","last_clean":"2024-08-17T02:27:25.461874+0000","last_became_active":"2024-08-17T02:27:25.455125+0000","last_became_peered":"2024-08-17T02:27:25.455125+0000","last_unstale":"2024-08-17T02:27:25.461874+0000","last_undegraded":"2024-08-17T02:27:25.461874+0000","last_fullsized":"2024-08-17T02:27:25.461874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459752+0000","last_change":"2024-08-17T02:27:25.453226+0000","last_active":"2024-08-17T02:27:25.459752+0000","last_peered":"2024-08-17T02:27:25.459752+0000","last_clean":"2024-08-17T02:27:25.459752+0000","last_became_active":"2024-08-17T02:27:25.452935+0000","last_became_peered":"2024-08-17T02:27:25.452935+0000","last_unstale":"2024-08-17T02:27:25.459752+0000","last_undegraded":"2024-08-17T02:27:25.459752+0000","last_fullsized":"2024-08-17T02:27:25.459752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455153+0000","last_change":"2024-08-17T02:27:25.446924+0000","last_active":"2024-08-17T02:27:25.455153+0000","last_peered":"2024-08-17T02:27:25.455153+0000","last_clean":"2024-08-17T02:27:25.455153+0000","last_became_active":"2024-08-17T02:27:25.446221+0000","last_became_peered":"2024-08-17T02:27:25.446221+0000","last_unstale":"2024-08-17T02:27:25.455153+0000","last_undegraded":"2024-08-17T02:27:25.455153+0000","last_fullsized":"2024-08-17T02:27:25.455153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470821+0000","last_change":"2024-08-17T02:27:25.470009+0000","last_active":"2024-08-17T02:27:25.470821+0000","last_peered":"2024-08-17T02:27:25.470821+0000","last_clean":"2024-08-17T02:27:25.470821+0000","last_became_active":"2024-08-17T02:27:25.469648+0000","last_became_peered":"2024-08-17T02:27:25.469648+0000","last_unstale":"2024-08-17T02:27:25.470821+0000","last_undegraded":"2024-08-17T02:27:25.470821+0000","last_fullsized":"2024-08-17T02:27:25.470821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454890+0000","last_change":"2024-08-17T02:27:25.449603+0000","last_active":"2024-08-17T02:27:25.454890+0000","last_peered":"2024-08-17T02:27:25.454890+0000","last_clean":"2024-08-17T02:27:25.454890+0000","last_became_active":"2024-08-17T02:27:25.449260+0000","last_became_peered":"2024-08-17T02:27:25.449260+0000","last_unstale":"2024-08-17T02:27:25.454890+0000","last_undegraded":"2024-08-17T02:27:25.454890+0000","last_fullsized":"2024-08-17T02:27:25.454890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456632+0000","last_change":"2024-08-17T02:27:25.452008+0000","last_active":"2024-08-17T02:27:25.456632+0000","last_peered":"2024-08-17T02:27:25.456632+0000","last_clean":"2024-08-17T02:27:25.456632+0000","last_became_active":"2024-08-17T02:27:25.451745+0000","last_became_peered":"2024-08-17T02:27:25.451745+0000","last_unstale":"2024-08-17T02:27:25.456632+0000","last_undegraded":"2024-08-17T02:27:25.456632+0000","last_fullsized":"2024-08-17T02:27:25.456632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462102+0000","last_change":"2024-08-17T02:27:25.456866+0000","last_active":"2024-08-17T02:27:25.462102+0000","last_peered":"2024-08-17T02:27:25.462102+0000","last_clean":"2024-08-17T02:27:25.462102+0000","last_became_active":"2024-08-17T02:27:25.456558+0000","last_became_peered":"2024-08-17T02:27:25.456558+0000","last_unstale":"2024-08-17T02:27:25.462102+0000","last_undegraded":"2024-08-17T02:27:25.462102+0000","last_fullsized":"2024-08-17T02:27:25.462102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466556+0000","last_change":"2024-08-17T02:27:25.455754+0000","last_active":"2024-08-17T02:27:25.466556+0000","last_peered":"2024-08-17T02:27:25.466556+0000","last_clean":"2024-08-17T02:27:25.466556+0000","last_became_active":"2024-08-17T02:27:25.449947+0000","last_became_peered":"2024-08-17T02:27:25.449947+0000","last_unstale":"2024-08-17T02:27:25.466556+0000","last_undegraded":"2024-08-17T02:27:25.466556+0000","last_fullsized":"2024-08-17T02:27:25.466556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460668+0000","last_change":"2024-08-17T02:27:25.451824+0000","last_active":"2024-08-17T02:27:25.460668+0000","last_peered":"2024-08-17T02:27:25.460668+0000","last_clean":"2024-08-17T02:27:25.460668+0000","last_became_active":"2024-08-17T02:27:25.451484+0000","last_became_peered":"2024-08-17T02:27:25.451484+0000","last_unstale":"2024-08-17T02:27:25.460668+0000","last_undegraded":"2024-08-17T02:27:25.460668+0000","last_fullsized":"2024-08-17T02:27:25.460668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438873+0000","last_change":"2024-08-17T02:27:25.437579+0000","last_active":"2024-08-17T02:27:25.438873+0000","last_peered":"2024-08-17T02:27:25.438873+0000","last_clean":"2024-08-17T02:27:25.438873+0000","last_became_active":"2024-08-17T02:27:25.437293+0000","last_became_peered":"2024-08-17T02:27:25.437293+0000","last_unstale":"2024-08-17T02:27:25.438873+0000","last_undegraded":"2024-08-17T02:27:25.438873+0000","last_fullsized":"2024-08-17T02:27:25.438873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451016+0000","last_change":"2024-08-17T02:27:25.439072+0000","last_active":"2024-08-17T02:27:25.451016+0000","last_peered":"2024-08-17T02:27:25.451016+0000","last_clean":"2024-08-17T02:27:25.451016+0000","last_became_active":"2024-08-17T02:27:25.438775+0000","last_became_peered":"2024-08-17T02:27:25.438775+0000","last_unstale":"2024-08-17T02:27:25.451016+0000","last_undegraded":"2024-08-17T02:27:25.451016+0000","last_fullsized":"2024-08-17T02:27:25.451016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441975+0000","last_change":"2024-08-17T02:27:25.435276+0000","last_active":"2024-08-17T02:27:25.441975+0000","last_peered":"2024-08-17T02:27:25.441975+0000","last_clean":"2024-08-17T02:27:25.441975+0000","last_became_active":"2024-08-17T02:27:25.433425+0000","last_became_peered":"2024-08-17T02:27:25.433425+0000","last_unstale":"2024-08-17T02:27:25.441975+0000","last_undegraded":"2024-08-17T02:27:25.441975+0000","last_fullsized":"2024-08-17T02:27:25.441975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461122+0000","last_change":"2024-08-17T02:27:25.441556+0000","last_active":"2024-08-17T02:27:25.461122+0000","last_peered":"2024-08-17T02:27:25.461122+0000","last_clean":"2024-08-17T02:27:25.461122+0000","last_became_active":"2024-08-17T02:27:25.441313+0000","last_became_peered":"2024-08-17T02:27:25.441313+0000","last_unstale":"2024-08-17T02:27:25.461122+0000","last_undegraded":"2024-08-17T02:27:25.461122+0000","last_fullsized":"2024-08-17T02:27:25.461122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454910+0000","last_change":"2024-08-17T02:27:25.450943+0000","last_active":"2024-08-17T02:27:25.454910+0000","last_peered":"2024-08-17T02:27:25.454910+0000","last_clean":"2024-08-17T02:27:25.454910+0000","last_became_active":"2024-08-17T02:27:25.449195+0000","last_became_peered":"2024-08-17T02:27:25.449195+0000","last_unstale":"2024-08-17T02:27:25.454910+0000","last_undegraded":"2024-08-17T02:27:25.454910+0000","last_fullsized":"2024-08-17T02:27:25.454910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439145+0000","last_change":"2024-08-17T02:27:25.436204+0000","last_active":"2024-08-17T02:27:25.439145+0000","last_peered":"2024-08-17T02:27:25.439145+0000","last_clean":"2024-08-17T02:27:25.439145+0000","last_became_active":"2024-08-17T02:27:25.435925+0000","last_became_peered":"2024-08-17T02:27:25.435925+0000","last_unstale":"2024-08-17T02:27:25.439145+0000","last_undegraded":"2024-08-17T02:27:25.439145+0000","last_fullsized":"2024-08-17T02:27:25.439145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456664+0000","last_change":"2024-08-17T02:27:25.452597+0000","last_active":"2024-08-17T02:27:25.456664+0000","last_peered":"2024-08-17T02:27:25.456664+0000","last_clean":"2024-08-17T02:27:25.456664+0000","last_became_active":"2024-08-17T02:27:25.452396+0000","last_became_peered":"2024-08-17T02:27:25.452396+0000","last_unstale":"2024-08-17T02:27:25.456664+0000","last_undegraded":"2024-08-17T02:27:25.456664+0000","last_fullsized":"2024-08-17T02:27:25.456664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451355+0000","last_change":"2024-08-17T02:27:25.448186+0000","last_active":"2024-08-17T02:27:25.451355+0000","last_peered":"2024-08-17T02:27:25.451355+0000","last_clean":"2024-08-17T02:27:25.451355+0000","last_became_active":"2024-08-17T02:27:25.446348+0000","last_became_peered":"2024-08-17T02:27:25.446348+0000","last_unstale":"2024-08-17T02:27:25.451355+0000","last_undegraded":"2024-08-17T02:27:25.451355+0000","last_fullsized":"2024-08-17T02:27:25.451355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446526+0000","last_change":"2024-08-17T02:27:25.440779+0000","last_active":"2024-08-17T02:27:25.446526+0000","last_peered":"2024-08-17T02:27:25.446526+0000","last_clean":"2024-08-17T02:27:25.446526+0000","last_became_active":"2024-08-17T02:27:25.440337+0000","last_became_peered":"2024-08-17T02:27:25.440337+0000","last_unstale":"2024-08-17T02:27:25.446526+0000","last_undegraded":"2024-08-17T02:27:25.446526+0000","last_fullsized":"2024-08-17T02:27:25.446526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456529+0000","last_change":"2024-08-17T02:27:25.449909+0000","last_active":"2024-08-17T02:27:25.456529+0000","last_peered":"2024-08-17T02:27:25.456529+0000","last_clean":"2024-08-17T02:27:25.456529+0000","last_became_active":"2024-08-17T02:27:25.449657+0000","last_became_peered":"2024-08-17T02:27:25.449657+0000","last_unstale":"2024-08-17T02:27:25.456529+0000","last_undegraded":"2024-08-17T02:27:25.456529+0000","last_fullsized":"2024-08-17T02:27:25.456529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451092+0000","last_change":"2024-08-17T02:27:25.439755+0000","last_active":"2024-08-17T02:27:25.451092+0000","last_peered":"2024-08-17T02:27:25.451092+0000","last_clean":"2024-08-17T02:27:25.451092+0000","last_became_active":"2024-08-17T02:27:25.439512+0000","last_became_peered":"2024-08-17T02:27:25.439512+0000","last_unstale":"2024-08-17T02:27:25.451092+0000","last_undegraded":"2024-08-17T02:27:25.451092+0000","last_fullsized":"2024-08-17T02:27:25.451092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451164+0000","last_change":"2024-08-17T02:27:25.445422+0000","last_active":"2024-08-17T02:27:25.451164+0000","last_peered":"2024-08-17T02:27:25.451164+0000","last_clean":"2024-08-17T02:27:25.451164+0000","last_became_active":"2024-08-17T02:27:25.445153+0000","last_became_peered":"2024-08-17T02:27:25.445153+0000","last_unstale":"2024-08-17T02:27:25.451164+0000","last_undegraded":"2024-08-17T02:27:25.451164+0000","last_fullsized":"2024-08-17T02:27:25.451164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450548+0000","last_change":"2024-08-17T02:27:25.445499+0000","last_active":"2024-08-17T02:27:25.450548+0000","last_peered":"2024-08-17T02:27:25.450548+0000","last_clean":"2024-08-17T02:27:25.450548+0000","last_became_active":"2024-08-17T02:27:25.445127+0000","last_became_peered":"2024-08-17T02:27:25.445127+0000","last_unstale":"2024-08-17T02:27:25.450548+0000","last_undegraded":"2024-08-17T02:27:25.450548+0000","last_fullsized":"2024-08-17T02:27:25.450548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466499+0000","last_change":"2024-08-17T02:27:25.460811+0000","last_active":"2024-08-17T02:27:25.466499+0000","last_peered":"2024-08-17T02:27:25.466499+0000","last_clean":"2024-08-17T02:27:25.466499+0000","last_became_active":"2024-08-17T02:27:25.460513+0000","last_became_peered":"2024-08-17T02:27:25.460513+0000","last_unstale":"2024-08-17T02:27:25.466499+0000","last_undegraded":"2024-08-17T02:27:25.466499+0000","last_fullsized":"2024-08-17T02:27:25.466499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468295+0000","last_change":"2024-08-17T02:27:25.466496+0000","last_active":"2024-08-17T02:27:25.468295+0000","last_peered":"2024-08-17T02:27:25.468295+0000","last_clean":"2024-08-17T02:27:25.468295+0000","last_became_active":"2024-08-17T02:27:25.466240+0000","last_became_peered":"2024-08-17T02:27:25.466240+0000","last_unstale":"2024-08-17T02:27:25.468295+0000","last_undegraded":"2024-08-17T02:27:25.468295+0000","last_fullsized":"2024-08-17T02:27:25.468295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467606+0000","last_change":"2024-08-17T02:27:25.461454+0000","last_active":"2024-08-17T02:27:25.467606+0000","last_peered":"2024-08-17T02:27:25.467606+0000","last_clean":"2024-08-17T02:27:25.467606+0000","last_became_active":"2024-08-17T02:27:25.460585+0000","last_became_peered":"2024-08-17T02:27:25.460585+0000","last_unstale":"2024-08-17T02:27:25.467606+0000","last_undegraded":"2024-08-17T02:27:25.467606+0000","last_fullsized":"2024-08-17T02:27:25.467606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.452006+0000","last_change":"2024-08-17T02:27:25.440879+0000","last_active":"2024-08-17T02:27:25.452006+0000","last_peered":"2024-08-17T02:27:25.452006+0000","last_clean":"2024-08-17T02:27:25.452006+0000","last_became_active":"2024-08-17T02:27:25.440638+0000","last_became_peered":"2024-08-17T02:27:25.440638+0000","last_unstale":"2024-08-17T02:27:25.452006+0000","last_undegraded":"2024-08-17T02:27:25.452006+0000","last_fullsized":"2024-08-17T02:27:25.452006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465682+0000","last_change":"2024-08-17T02:27:25.463971+0000","last_active":"2024-08-17T02:27:25.465682+0000","last_peered":"2024-08-17T02:27:25.465682+0000","last_clean":"2024-08-17T02:27:25.465682+0000","last_became_active":"2024-08-17T02:27:25.463657+0000","last_became_peered":"2024-08-17T02:27:25.463657+0000","last_unstale":"2024-08-17T02:27:25.465682+0000","last_undegraded":"2024-08-17T02:27:25.465682+0000","last_fullsized":"2024-08-17T02:27:25.465682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465530+0000","last_change":"2024-08-17T02:27:25.450808+0000","last_active":"2024-08-17T02:27:25.465530+0000","last_peered":"2024-08-17T02:27:25.465530+0000","last_clean":"2024-08-17T02:27:25.465530+0000","last_became_active":"2024-08-17T02:27:25.450474+0000","last_became_peered":"2024-08-17T02:27:25.450474+0000","last_unstale":"2024-08-17T02:27:25.465530+0000","last_undegraded":"2024-08-17T02:27:25.465530+0000","last_fullsized":"2024-08-17T02:27:25.465530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464102+0000","last_change":"2024-08-17T02:27:25.462561+0000","last_active":"2024-08-17T02:27:25.464102+0000","last_peered":"2024-08-17T02:27:25.464102+0000","last_clean":"2024-08-17T02:27:25.464102+0000","last_became_active":"2024-08-17T02:27:25.462314+0000","last_became_peered":"2024-08-17T02:27:25.462314+0000","last_unstale":"2024-08-17T02:27:25.464102+0000","last_undegraded":"2024-08-17T02:27:25.464102+0000","last_fullsized":"2024-08-17T02:27:25.464102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:55.384786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468210+0000","last_change":"2024-08-17T02:27:25.465776+0000","last_active":"2024-08-17T02:27:25.468210+0000","last_peered":"2024-08-17T02:27:25.468210+0000","last_clean":"2024-08-17T02:27:25.468210+0000","last_became_active":"2024-08-17T02:27:25.465517+0000","last_became_peered":"2024-08-17T02:27:25.465517+0000","last_unstale":"2024-08-17T02:27:25.468210+0000","last_undegraded":"2024-08-17T02:27:25.468210+0000","last_fullsized":"2024-08-17T02:27:25.468210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446395+0000","last_change":"2024-08-17T02:27:25.436230+0000","last_active":"2024-08-17T02:27:25.446395+0000","last_peered":"2024-08-17T02:27:25.446395+0000","last_clean":"2024-08-17T02:27:25.446395+0000","last_became_active":"2024-08-17T02:27:25.435981+0000","last_became_peered":"2024-08-17T02:27:25.435981+0000","last_unstale":"2024-08-17T02:27:25.446395+0000","last_undegraded":"2024-08-17T02:27:25.446395+0000","last_fullsized":"2024-08-17T02:27:25.446395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455807+0000","last_change":"2024-08-17T02:27:25.453066+0000","last_active":"2024-08-17T02:27:25.455807+0000","last_peered":"2024-08-17T02:27:25.455807+0000","last_clean":"2024-08-17T02:27:25.455807+0000","last_became_active":"2024-08-17T02:27:25.452821+0000","last_became_peered":"2024-08-17T02:27:25.452821+0000","last_unstale":"2024-08-17T02:27:25.455807+0000","last_undegraded":"2024-08-17T02:27:25.455807+0000","last_fullsized":"2024-08-17T02:27:25.455807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:07:02.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441899+0000","last_change":"2024-08-17T02:27:25.430552+0000","last_active":"2024-08-17T02:27:25.441899+0000","last_peered":"2024-08-17T02:27:25.441899+0000","last_clean":"2024-08-17T02:27:25.441899+0000","last_became_active":"2024-08-17T02:27:25.429351+0000","last_became_peered":"2024-08-17T02:27:25.429351+0000","last_unstale":"2024-08-17T02:27:25.441899+0000","last_undegraded":"2024-08-17T02:27:25.441899+0000","last_fullsized":"2024-08-17T02:27:25.441899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:57.515905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470407+0000","last_change":"2024-08-17T02:27:24.450643+0000","last_active":"2024-08-17T02:27:25.470407+0000","last_peered":"2024-08-17T02:27:25.470407+0000","last_clean":"2024-08-17T02:27:25.470407+0000","last_became_active":"2024-08-17T02:27:24.450201+0000","last_became_peered":"2024-08-17T02:27:24.450201+0000","last_unstale":"2024-08-17T02:27:25.470407+0000","last_undegraded":"2024-08-17T02:27:25.470407+0000","last_fullsized":"2024-08-17T02:27:25.470407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451185+0000","last_change":"2024-08-17T02:27:25.445553+0000","last_active":"2024-08-17T02:27:25.451185+0000","last_peered":"2024-08-17T02:27:25.451185+0000","last_clean":"2024-08-17T02:27:25.451185+0000","last_became_active":"2024-08-17T02:27:25.445275+0000","last_became_peered":"2024-08-17T02:27:25.445275+0000","last_unstale":"2024-08-17T02:27:25.451185+0000","last_undegraded":"2024-08-17T02:27:25.451185+0000","last_fullsized":"2024-08-17T02:27:25.451185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461254+0000","last_change":"2024-08-17T02:27:24.439165+0000","last_active":"2024-08-17T02:27:25.461254+0000","last_peered":"2024-08-17T02:27:25.461254+0000","last_clean":"2024-08-17T02:27:25.461254+0000","last_became_active":"2024-08-17T02:27:24.437397+0000","last_became_peered":"2024-08-17T02:27:24.437397+0000","last_unstale":"2024-08-17T02:27:25.461254+0000","last_undegraded":"2024-08-17T02:27:25.461254+0000","last_fullsized":"2024-08-17T02:27:25.461254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.429962+0000","last_change":"2024-08-17T02:27:24.445238+0000","last_active":"2024-08-17T02:27:25.429962+0000","last_peered":"2024-08-17T02:27:25.429962+0000","last_clean":"2024-08-17T02:27:25.429962+0000","last_became_active":"2024-08-17T02:27:24.444156+0000","last_became_peered":"2024-08-17T02:27:24.444156+0000","last_unstale":"2024-08-17T02:27:25.429962+0000","last_undegraded":"2024-08-17T02:27:25.429962+0000","last_fullsized":"2024-08-17T02:27:25.429962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466566+0000","last_change":"2024-08-17T02:27:25.456302+0000","last_active":"2024-08-17T02:27:25.466566+0000","last_peered":"2024-08-17T02:27:25.466566+0000","last_clean":"2024-08-17T02:27:25.466566+0000","last_became_active":"2024-08-17T02:27:25.456006+0000","last_became_peered":"2024-08-17T02:27:25.456006+0000","last_unstale":"2024-08-17T02:27:25.466566+0000","last_undegraded":"2024-08-17T02:27:25.466566+0000","last_fullsized":"2024-08-17T02:27:25.466566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.430567+0000","last_change":"2024-08-17T02:27:24.442260+0000","last_active":"2024-08-17T02:27:25.430567+0000","last_peered":"2024-08-17T02:27:25.430567+0000","last_clean":"2024-08-17T02:27:25.430567+0000","last_became_active":"2024-08-17T02:27:24.440158+0000","last_became_peered":"2024-08-17T02:27:24.440158+0000","last_unstale":"2024-08-17T02:27:25.430567+0000","last_undegraded":"2024-08-17T02:27:25.430567+0000","last_fullsized":"2024-08-17T02:27:25.430567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.442431+0000","last_change":"2024-08-17T02:27:25.439235+0000","last_active":"2024-08-17T02:27:25.442431+0000","last_peered":"2024-08-17T02:27:25.442431+0000","last_clean":"2024-08-17T02:27:25.442431+0000","last_became_active":"2024-08-17T02:27:25.438932+0000","last_became_peered":"2024-08-17T02:27:25.438932+0000","last_unstale":"2024-08-17T02:27:25.442431+0000","last_undegraded":"2024-08-17T02:27:25.442431+0000","last_fullsized":"2024-08-17T02:27:25.442431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.426017+0000","last_change":"2024-08-17T02:27:24.439888+0000","last_active":"2024-08-17T02:27:25.426017+0000","last_peered":"2024-08-17T02:27:25.426017+0000","last_clean":"2024-08-17T02:27:25.426017+0000","last_became_active":"2024-08-17T02:27:24.439256+0000","last_became_peered":"2024-08-17T02:27:24.439256+0000","last_unstale":"2024-08-17T02:27:25.426017+0000","last_undegraded":"2024-08-17T02:27:25.426017+0000","last_fullsized":"2024-08-17T02:27:25.426017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450765+0000","last_change":"2024-08-17T02:27:25.445654+0000","last_active":"2024-08-17T02:27:25.450765+0000","last_peered":"2024-08-17T02:27:25.450765+0000","last_clean":"2024-08-17T02:27:25.450765+0000","last_became_active":"2024-08-17T02:27:25.445315+0000","last_became_peered":"2024-08-17T02:27:25.445315+0000","last_unstale":"2024-08-17T02:27:25.450765+0000","last_undegraded":"2024-08-17T02:27:25.450765+0000","last_fullsized":"2024-08-17T02:27:25.450765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431851+0000","last_change":"2024-08-17T02:27:24.439678+0000","last_active":"2024-08-17T02:27:25.431851+0000","last_peered":"2024-08-17T02:27:25.431851+0000","last_clean":"2024-08-17T02:27:25.431851+0000","last_became_active":"2024-08-17T02:27:24.438827+0000","last_became_peered":"2024-08-17T02:27:24.438827+0000","last_unstale":"2024-08-17T02:27:25.431851+0000","last_undegraded":"2024-08-17T02:27:25.431851+0000","last_fullsized":"2024-08-17T02:27:25.431851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453338+0000","last_change":"2024-08-17T02:27:25.446818+0000","last_active":"2024-08-17T02:27:25.453338+0000","last_peered":"2024-08-17T02:27:25.453338+0000","last_clean":"2024-08-17T02:27:25.453338+0000","last_became_active":"2024-08-17T02:27:25.446160+0000","last_became_peered":"2024-08-17T02:27:25.446160+0000","last_unstale":"2024-08-17T02:27:25.453338+0000","last_undegraded":"2024-08-17T02:27:25.453338+0000","last_fullsized":"2024-08-17T02:27:25.453338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461740+0000","last_change":"2024-08-17T02:27:24.444574+0000","last_active":"2024-08-17T02:27:25.461740+0000","last_peered":"2024-08-17T02:27:25.461740+0000","last_clean":"2024-08-17T02:27:25.461740+0000","last_became_active":"2024-08-17T02:27:24.444333+0000","last_became_peered":"2024-08-17T02:27:24.444333+0000","last_unstale":"2024-08-17T02:27:25.461740+0000","last_undegraded":"2024-08-17T02:27:25.461740+0000","last_fullsized":"2024-08-17T02:27:25.461740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457512+0000","last_change":"2024-08-17T02:27:25.444360+0000","last_active":"2024-08-17T02:27:25.457512+0000","last_peered":"2024-08-17T02:27:25.457512+0000","last_clean":"2024-08-17T02:27:25.457512+0000","last_became_active":"2024-08-17T02:27:25.444106+0000","last_became_peered":"2024-08-17T02:27:25.444106+0000","last_unstale":"2024-08-17T02:27:25.457512+0000","last_undegraded":"2024-08-17T02:27:25.457512+0000","last_fullsized":"2024-08-17T02:27:25.457512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:43.203136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.472906+0000","last_change":"2024-08-17T02:27:24.445437+0000","last_active":"2024-08-17T02:27:25.472906+0000","last_peered":"2024-08-17T02:27:25.472906+0000","last_clean":"2024-08-17T02:27:25.472906+0000","last_became_active":"2024-08-17T02:27:24.445008+0000","last_became_peered":"2024-08-17T02:27:24.445008+0000","last_unstale":"2024-08-17T02:27:25.472906+0000","last_undegraded":"2024-08-17T02:27:25.472906+0000","last_fullsized":"2024-08-17T02:27:25.472906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462054+0000","last_change":"2024-08-17T02:27:25.456825+0000","last_active":"2024-08-17T02:27:25.462054+0000","last_peered":"2024-08-17T02:27:25.462054+0000","last_clean":"2024-08-17T02:27:25.462054+0000","last_became_active":"2024-08-17T02:27:25.456323+0000","last_became_peered":"2024-08-17T02:27:25.456323+0000","last_unstale":"2024-08-17T02:27:25.462054+0000","last_undegraded":"2024-08-17T02:27:25.462054+0000","last_fullsized":"2024-08-17T02:27:25.462054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464743+0000","last_change":"2024-08-17T02:27:24.438473+0000","last_active":"2024-08-17T02:27:25.464743+0000","last_peered":"2024-08-17T02:27:25.464743+0000","last_clean":"2024-08-17T02:27:25.464743+0000","last_became_active":"2024-08-17T02:27:24.438205+0000","last_became_peered":"2024-08-17T02:27:24.438205+0000","last_unstale":"2024-08-17T02:27:25.464743+0000","last_undegraded":"2024-08-17T02:27:25.464743+0000","last_fullsized":"2024-08-17T02:27:25.464743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:56.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454929+0000","last_change":"2024-08-17T02:27:25.451195+0000","last_active":"2024-08-17T02:27:25.454929+0000","last_peered":"2024-08-17T02:27:25.454929+0000","last_clean":"2024-08-17T02:27:25.454929+0000","last_became_active":"2024-08-17T02:27:25.444332+0000","last_became_peered":"2024-08-17T02:27:25.444332+0000","last_unstale":"2024-08-17T02:27:25.454929+0000","last_undegraded":"2024-08-17T02:27:25.454929+0000","last_fullsized":"2024-08-17T02:27:25.454929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431434+0000","last_change":"2024-08-17T02:27:24.444612+0000","last_active":"2024-08-17T02:27:25.431434+0000","last_peered":"2024-08-17T02:27:25.431434+0000","last_clean":"2024-08-17T02:27:25.431434+0000","last_became_active":"2024-08-17T02:27:24.444307+0000","last_became_peered":"2024-08-17T02:27:24.444307+0000","last_unstale":"2024-08-17T02:27:25.431434+0000","last_undegraded":"2024-08-17T02:27:25.431434+0000","last_fullsized":"2024-08-17T02:27:25.431434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462196+0000","last_change":"2024-08-17T02:27:25.458229+0000","last_active":"2024-08-17T02:27:25.462196+0000","last_peered":"2024-08-17T02:27:25.462196+0000","last_clean":"2024-08-17T02:27:25.462196+0000","last_became_active":"2024-08-17T02:27:25.457949+0000","last_became_peered":"2024-08-17T02:27:25.457949+0000","last_unstale":"2024-08-17T02:27:25.462196+0000","last_undegraded":"2024-08-17T02:27:25.462196+0000","last_fullsized":"2024-08-17T02:27:25.462196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425557+0000","last_change":"2024-08-17T02:27:24.435541+0000","last_active":"2024-08-17T02:27:25.425557+0000","last_peered":"2024-08-17T02:27:25.425557+0000","last_clean":"2024-08-17T02:27:25.425557+0000","last_became_active":"2024-08-17T02:27:24.435267+0000","last_became_peered":"2024-08-17T02:27:24.435267+0000","last_unstale":"2024-08-17T02:27:25.425557+0000","last_undegraded":"2024-08-17T02:27:25.425557+0000","last_fullsized":"2024-08-17T02:27:25.425557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453321+0000","last_change":"2024-08-17T02:27:25.442847+0000","last_active":"2024-08-17T02:27:25.453321+0000","last_peered":"2024-08-17T02:27:25.453321+0000","last_clean":"2024-08-17T02:27:25.453321+0000","last_became_active":"2024-08-17T02:27:25.442470+0000","last_became_peered":"2024-08-17T02:27:25.442470+0000","last_unstale":"2024-08-17T02:27:25.453321+0000","last_undegraded":"2024-08-17T02:27:25.453321+0000","last_fullsized":"2024-08-17T02:27:25.453321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:50.390710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464153+0000","last_change":"2024-08-17T02:27:24.437545+0000","last_active":"2024-08-17T02:27:25.464153+0000","last_peered":"2024-08-17T02:27:25.464153+0000","last_clean":"2024-08-17T02:27:25.464153+0000","last_became_active":"2024-08-17T02:27:24.437177+0000","last_became_peered":"2024-08-17T02:27:24.437177+0000","last_unstale":"2024-08-17T02:27:25.464153+0000","last_undegraded":"2024-08-17T02:27:25.464153+0000","last_fullsized":"2024-08-17T02:27:25.464153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462291+0000","last_change":"2024-08-17T02:27:25.458884+0000","last_active":"2024-08-17T02:27:25.462291+0000","last_peered":"2024-08-17T02:27:25.462291+0000","last_clean":"2024-08-17T02:27:25.462291+0000","last_became_active":"2024-08-17T02:27:25.458541+0000","last_became_peered":"2024-08-17T02:27:25.458541+0000","last_unstale":"2024-08-17T02:27:25.462291+0000","last_undegraded":"2024-08-17T02:27:25.462291+0000","last_fullsized":"2024-08-17T02:27:25.462291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461445+0000","last_change":"2024-08-17T02:27:24.438345+0000","last_active":"2024-08-17T02:27:25.461445+0000","last_peered":"2024-08-17T02:27:25.461445+0000","last_clean":"2024-08-17T02:27:25.461445+0000","last_became_active":"2024-08-17T02:27:24.438014+0000","last_became_peered":"2024-08-17T02:27:24.438014+0000","last_unstale":"2024-08-17T02:27:25.461445+0000","last_undegraded":"2024-08-17T02:27:25.461445+0000","last_fullsized":"2024-08-17T02:27:25.461445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:51.236659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460458+0000","last_change":"2024-08-17T02:27:25.451119+0000","last_active":"2024-08-17T02:27:25.460458+0000","last_peered":"2024-08-17T02:27:25.460458+0000","last_clean":"2024-08-17T02:27:25.460458+0000","last_became_active":"2024-08-17T02:27:25.450850+0000","last_became_peered":"2024-08-17T02:27:25.450850+0000","last_unstale":"2024-08-17T02:27:25.460458+0000","last_undegraded":"2024-08-17T02:27:25.460458+0000","last_fullsized":"2024-08-17T02:27:25.460458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466776+0000","last_change":"2024-08-17T02:27:24.448256+0000","last_active":"2024-08-17T02:27:25.466776+0000","last_peered":"2024-08-17T02:27:25.466776+0000","last_clean":"2024-08-17T02:27:25.466776+0000","last_became_active":"2024-08-17T02:27:24.447922+0000","last_became_peered":"2024-08-17T02:27:24.447922+0000","last_unstale":"2024-08-17T02:27:25.466776+0000","last_undegraded":"2024-08-17T02:27:25.466776+0000","last_fullsized":"2024-08-17T02:27:25.466776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462323+0000","last_change":"2024-08-17T02:27:25.458937+0000","last_active":"2024-08-17T02:27:25.462323+0000","last_peered":"2024-08-17T02:27:25.462323+0000","last_clean":"2024-08-17T02:27:25.462323+0000","last_became_active":"2024-08-17T02:27:25.458689+0000","last_became_peered":"2024-08-17T02:27:25.458689+0000","last_unstale":"2024-08-17T02:27:25.462323+0000","last_undegraded":"2024-08-17T02:27:25.462323+0000","last_fullsized":"2024-08-17T02:27:25.462323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461606+0000","last_change":"2024-08-17T02:27:24.436502+0000","last_active":"2024-08-17T02:27:25.461606+0000","last_peered":"2024-08-17T02:27:25.461606+0000","last_clean":"2024-08-17T02:27:25.461606+0000","last_became_active":"2024-08-17T02:27:24.435360+0000","last_became_peered":"2024-08-17T02:27:24.435360+0000","last_unstale":"2024-08-17T02:27:25.461606+0000","last_undegraded":"2024-08-17T02:27:25.461606+0000","last_fullsized":"2024-08-17T02:27:25.461606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467392+0000","last_change":"2024-08-17T02:27:25.465732+0000","last_active":"2024-08-17T02:27:25.467392+0000","last_peered":"2024-08-17T02:27:25.467392+0000","last_clean":"2024-08-17T02:27:25.467392+0000","last_became_active":"2024-08-17T02:27:25.465477+0000","last_became_peered":"2024-08-17T02:27:25.465477+0000","last_unstale":"2024-08-17T02:27:25.467392+0000","last_undegraded":"2024-08-17T02:27:25.467392+0000","last_fullsized":"2024-08-17T02:27:25.467392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.436763+0000","last_change":"2024-08-17T02:27:24.447436+0000","last_active":"2024-08-17T02:27:25.436763+0000","last_peered":"2024-08-17T02:27:25.436763+0000","last_clean":"2024-08-17T02:27:25.436763+0000","last_became_active":"2024-08-17T02:27:24.446567+0000","last_became_peered":"2024-08-17T02:27:24.446567+0000","last_unstale":"2024-08-17T02:27:25.436763+0000","last_undegraded":"2024-08-17T02:27:25.436763+0000","last_fullsized":"2024-08-17T02:27:25.436763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461787+0000","last_change":"2024-08-17T02:27:25.453401+0000","last_active":"2024-08-17T02:27:25.461787+0000","last_peered":"2024-08-17T02:27:25.461787+0000","last_clean":"2024-08-17T02:27:25.461787+0000","last_became_active":"2024-08-17T02:27:25.453012+0000","last_became_peered":"2024-08-17T02:27:25.453012+0000","last_unstale":"2024-08-17T02:27:25.461787+0000","last_undegraded":"2024-08-17T02:27:25.461787+0000","last_fullsized":"2024-08-17T02:27:25.461787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434221+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:27:25.434221+0000","last_peered":"2024-08-17T02:27:25.434221+0000","last_clean":"2024-08-17T02:27:25.434221+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:27:25.434221+0000","last_undegraded":"2024-08-17T02:27:25.434221+0000","last_fullsized":"2024-08-17T02:27:25.434221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.428317+0000","last_change":"2024-08-17T02:27:24.434655+0000","last_active":"2024-08-17T02:27:25.428317+0000","last_peered":"2024-08-17T02:27:25.428317+0000","last_clean":"2024-08-17T02:27:25.428317+0000","last_became_active":"2024-08-17T02:27:24.434310+0000","last_became_peered":"2024-08-17T02:27:24.434310+0000","last_unstale":"2024-08-17T02:27:25.428317+0000","last_undegraded":"2024-08-17T02:27:25.428317+0000","last_fullsized":"2024-08-17T02:27:25.428317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460185+0000","last_change":"2024-08-17T02:27:25.447580+0000","last_active":"2024-08-17T02:27:25.460185+0000","last_peered":"2024-08-17T02:27:25.460185+0000","last_clean":"2024-08-17T02:27:25.460185+0000","last_became_active":"2024-08-17T02:27:25.447348+0000","last_became_peered":"2024-08-17T02:27:25.447348+0000","last_unstale":"2024-08-17T02:27:25.460185+0000","last_undegraded":"2024-08-17T02:27:25.460185+0000","last_fullsized":"2024-08-17T02:27:25.460185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434137+0000","last_change":"2024-08-17T02:27:24.449181+0000","last_active":"2024-08-17T02:27:25.434137+0000","last_peered":"2024-08-17T02:27:25.434137+0000","last_clean":"2024-08-17T02:27:25.434137+0000","last_became_active":"2024-08-17T02:27:24.448621+0000","last_became_peered":"2024-08-17T02:27:24.448621+0000","last_unstale":"2024-08-17T02:27:25.434137+0000","last_undegraded":"2024-08-17T02:27:25.434137+0000","last_fullsized":"2024-08-17T02:27:25.434137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455088+0000","last_change":"2024-08-17T02:27:25.451371+0000","last_active":"2024-08-17T02:27:25.455088+0000","last_peered":"2024-08-17T02:27:25.455088+0000","last_clean":"2024-08-17T02:27:25.455088+0000","last_became_active":"2024-08-17T02:27:25.451050+0000","last_became_peered":"2024-08-17T02:27:25.451050+0000","last_unstale":"2024-08-17T02:27:25.455088+0000","last_undegraded":"2024-08-17T02:27:25.455088+0000","last_fullsized":"2024-08-17T02:27:25.455088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431977+0000","last_change":"2024-08-17T02:27:24.445048+0000","last_active":"2024-08-17T02:27:25.431977+0000","last_peered":"2024-08-17T02:27:25.431977+0000","last_clean":"2024-08-17T02:27:25.431977+0000","last_became_active":"2024-08-17T02:27:24.444710+0000","last_became_peered":"2024-08-17T02:27:24.444710+0000","last_unstale":"2024-08-17T02:27:25.431977+0000","last_undegraded":"2024-08-17T02:27:25.431977+0000","last_fullsized":"2024-08-17T02:27:25.431977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.444039+0000","last_change":"2024-08-17T02:27:25.440656+0000","last_active":"2024-08-17T02:27:25.444039+0000","last_peered":"2024-08-17T02:27:25.444039+0000","last_clean":"2024-08-17T02:27:25.444039+0000","last_became_active":"2024-08-17T02:27:25.440321+0000","last_became_peered":"2024-08-17T02:27:25.440321+0000","last_unstale":"2024-08-17T02:27:25.444039+0000","last_undegraded":"2024-08-17T02:27:25.444039+0000","last_fullsized":"2024-08-17T02:27:25.444039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431535+0000","last_change":"2024-08-17T02:27:24.437523+0000","last_active":"2024-08-17T02:27:25.431535+0000","last_peered":"2024-08-17T02:27:25.431535+0000","last_clean":"2024-08-17T02:27:25.431535+0000","last_became_active":"2024-08-17T02:27:24.437285+0000","last_became_peered":"2024-08-17T02:27:24.437285+0000","last_unstale":"2024-08-17T02:27:25.431535+0000","last_undegraded":"2024-08-17T02:27:25.431535+0000","last_fullsized":"2024-08-17T02:27:25.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459340+0000","last_change":"2024-08-17T02:27:25.449648+0000","last_active":"2024-08-17T02:27:25.459340+0000","last_peered":"2024-08-17T02:27:25.459340+0000","last_clean":"2024-08-17T02:27:25.459340+0000","last_became_active":"2024-08-17T02:27:25.447084+0000","last_became_peered":"2024-08-17T02:27:25.447084+0000","last_unstale":"2024-08-17T02:27:25.459340+0000","last_undegraded":"2024-08-17T02:27:25.459340+0000","last_fullsized":"2024-08-17T02:27:25.459340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425327+0000","last_change":"2024-08-17T02:27:24.437263+0000","last_active":"2024-08-17T02:27:25.425327+0000","last_peered":"2024-08-17T02:27:25.425327+0000","last_clean":"2024-08-17T02:27:25.425327+0000","last_became_active":"2024-08-17T02:27:24.436992+0000","last_became_peered":"2024-08-17T02:27:24.436992+0000","last_unstale":"2024-08-17T02:27:25.425327+0000","last_undegraded":"2024-08-17T02:27:25.425327+0000","last_fullsized":"2024-08-17T02:27:25.425327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468312+0000","last_change":"2024-08-17T02:27:25.466345+0000","last_active":"2024-08-17T02:27:25.468312+0000","last_peered":"2024-08-17T02:27:25.468312+0000","last_clean":"2024-08-17T02:27:25.468312+0000","last_became_active":"2024-08-17T02:27:25.466038+0000","last_became_peered":"2024-08-17T02:27:25.466038+0000","last_unstale":"2024-08-17T02:27:25.468312+0000","last_undegraded":"2024-08-17T02:27:25.468312+0000","last_fullsized":"2024-08-17T02:27:25.468312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438148+0000","last_change":"2024-08-17T02:27:24.449902+0000","last_active":"2024-08-17T02:27:25.438148+0000","last_peered":"2024-08-17T02:27:25.438148+0000","last_clean":"2024-08-17T02:27:25.438148+0000","last_became_active":"2024-08-17T02:27:24.449525+0000","last_became_peered":"2024-08-17T02:27:24.449525+0000","last_unstale":"2024-08-17T02:27:25.438148+0000","last_undegraded":"2024-08-17T02:27:25.438148+0000","last_fullsized":"2024-08-17T02:27:25.438148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.445653+0000","last_change":"2024-08-17T02:27:25.440529+0000","last_active":"2024-08-17T02:27:25.445653+0000","last_peered":"2024-08-17T02:27:25.445653+0000","last_clean":"2024-08-17T02:27:25.445653+0000","last_became_active":"2024-08-17T02:27:25.440188+0000","last_became_peered":"2024-08-17T02:27:25.440188+0000","last_unstale":"2024-08-17T02:27:25.445653+0000","last_undegraded":"2024-08-17T02:27:25.445653+0000","last_fullsized":"2024-08-17T02:27:25.445653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:26.541464+0000","last_change":"2024-08-17T02:27:24.435826+0000","last_active":"2024-08-17T02:27:26.541464+0000","last_peered":"2024-08-17T02:27:26.541464+0000","last_clean":"2024-08-17T02:27:26.541464+0000","last_became_active":"2024-08-17T02:27:24.435410+0000","last_became_peered":"2024-08-17T02:27:24.435410+0000","last_unstale":"2024-08-17T02:27:26.541464+0000","last_undegraded":"2024-08-17T02:27:26.541464+0000","last_fullsized":"2024-08-17T02:27:26.541464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460275+0000","last_change":"2024-08-17T02:27:25.456094+0000","last_active":"2024-08-17T02:27:25.460275+0000","last_peered":"2024-08-17T02:27:25.460275+0000","last_clean":"2024-08-17T02:27:25.460275+0000","last_became_active":"2024-08-17T02:27:25.454642+0000","last_became_peered":"2024-08-17T02:27:25.454642+0000","last_unstale":"2024-08-17T02:27:25.460275+0000","last_undegraded":"2024-08-17T02:27:25.460275+0000","last_fullsized":"2024-08-17T02:27:25.460275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464709+0000","last_change":"2024-08-17T02:27:24.452692+0000","last_active":"2024-08-17T02:27:25.464709+0000","last_peered":"2024-08-17T02:27:25.464709+0000","last_clean":"2024-08-17T02:27:25.464709+0000","last_became_active":"2024-08-17T02:27:24.452303+0000","last_became_peered":"2024-08-17T02:27:24.452303+0000","last_unstale":"2024-08-17T02:27:25.464709+0000","last_undegraded":"2024-08-17T02:27:25.464709+0000","last_fullsized":"2024-08-17T02:27:25.464709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457334+0000","last_change":"2024-08-17T02:27:25.450938+0000","last_active":"2024-08-17T02:27:25.457334+0000","last_peered":"2024-08-17T02:27:25.457334+0000","last_clean":"2024-08-17T02:27:25.457334+0000","last_became_active":"2024-08-17T02:27:25.442137+0000","last_became_peered":"2024-08-17T02:27:25.442137+0000","last_unstale":"2024-08-17T02:27:25.457334+0000","last_undegraded":"2024-08-17T02:27:25.457334+0000","last_fullsized":"2024-08-17T02:27:25.457334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434024+0000","last_change":"2024-08-17T02:27:24.447388+0000","last_active":"2024-08-17T02:27:25.434024+0000","last_peered":"2024-08-17T02:27:25.434024+0000","last_clean":"2024-08-17T02:27:25.434024+0000","last_became_active":"2024-08-17T02:27:24.447000+0000","last_became_peered":"2024-08-17T02:27:24.447000+0000","last_unstale":"2024-08-17T02:27:25.434024+0000","last_undegraded":"2024-08-17T02:27:25.434024+0000","last_fullsized":"2024-08-17T02:27:25.434024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.458050+0000","last_change":"2024-08-17T02:27:25.448457+0000","last_active":"2024-08-17T02:27:25.458050+0000","last_peered":"2024-08-17T02:27:25.458050+0000","last_clean":"2024-08-17T02:27:25.458050+0000","last_became_active":"2024-08-17T02:27:25.441769+0000","last_became_peered":"2024-08-17T02:27:25.441769+0000","last_unstale":"2024-08-17T02:27:25.458050+0000","last_undegraded":"2024-08-17T02:27:25.458050+0000","last_fullsized":"2024-08-17T02:27:25.458050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424675+0000","last_change":"2024-08-17T02:27:24.443925+0000","last_active":"2024-08-17T02:27:25.424675+0000","last_peered":"2024-08-17T02:27:25.424675+0000","last_clean":"2024-08-17T02:27:25.424675+0000","last_became_active":"2024-08-17T02:27:24.443608+0000","last_became_peered":"2024-08-17T02:27:24.443608+0000","last_unstale":"2024-08-17T02:27:25.424675+0000","last_undegraded":"2024-08-17T02:27:25.424675+0000","last_fullsized":"2024-08-17T02:27:25.424675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467733+0000","last_change":"2024-08-17T02:27:25.462228+0000","last_active":"2024-08-17T02:27:25.467733+0000","last_peered":"2024-08-17T02:27:25.467733+0000","last_clean":"2024-08-17T02:27:25.467733+0000","last_became_active":"2024-08-17T02:27:25.448840+0000","last_became_peered":"2024-08-17T02:27:25.448840+0000","last_unstale":"2024-08-17T02:27:25.467733+0000","last_undegraded":"2024-08-17T02:27:25.467733+0000","last_fullsized":"2024-08-17T02:27:25.467733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424091+0000","last_change":"2024-08-17T02:27:24.445306+0000","last_active":"2024-08-17T02:27:25.424091+0000","last_peered":"2024-08-17T02:27:25.424091+0000","last_clean":"2024-08-17T02:27:25.424091+0000","last_became_active":"2024-08-17T02:27:24.445012+0000","last_became_peered":"2024-08-17T02:27:24.445012+0000","last_unstale":"2024-08-17T02:27:25.424091+0000","last_undegraded":"2024-08-17T02:27:25.424091+0000","last_fullsized":"2024-08-17T02:27:25.424091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467550+0000","last_change":"2024-08-17T02:27:25.461234+0000","last_active":"2024-08-17T02:27:25.467550+0000","last_peered":"2024-08-17T02:27:25.467550+0000","last_clean":"2024-08-17T02:27:25.467550+0000","last_became_active":"2024-08-17T02:27:25.455041+0000","last_became_peered":"2024-08-17T02:27:25.455041+0000","last_unstale":"2024-08-17T02:27:25.467550+0000","last_undegraded":"2024-08-17T02:27:25.467550+0000","last_fullsized":"2024-08-17T02:27:25.467550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460395+0000","last_change":"2024-08-17T02:27:24.449904+0000","last_active":"2024-08-17T02:27:25.460395+0000","last_peered":"2024-08-17T02:27:25.460395+0000","last_clean":"2024-08-17T02:27:25.460395+0000","last_became_active":"2024-08-17T02:27:24.449492+0000","last_became_peered":"2024-08-17T02:27:24.449492+0000","last_unstale":"2024-08-17T02:27:25.460395+0000","last_undegraded":"2024-08-17T02:27:25.460395+0000","last_fullsized":"2024-08-17T02:27:25.460395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439656+0000","last_change":"2024-08-17T02:27:25.432877+0000","last_active":"2024-08-17T02:27:25.439656+0000","last_peered":"2024-08-17T02:27:25.439656+0000","last_clean":"2024-08-17T02:27:25.439656+0000","last_became_active":"2024-08-17T02:27:25.432587+0000","last_became_peered":"2024-08-17T02:27:25.432587+0000","last_unstale":"2024-08-17T02:27:25.439656+0000","last_undegraded":"2024-08-17T02:27:25.439656+0000","last_fullsized":"2024-08-17T02:27:25.439656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454969+0000","last_change":"2024-08-17T02:27:25.448549+0000","last_active":"2024-08-17T02:27:25.454969+0000","last_peered":"2024-08-17T02:27:25.454969+0000","last_clean":"2024-08-17T02:27:25.454969+0000","last_became_active":"2024-08-17T02:27:25.448001+0000","last_became_peered":"2024-08-17T02:27:25.448001+0000","last_unstale":"2024-08-17T02:27:25.454969+0000","last_undegraded":"2024-08-17T02:27:25.454969+0000","last_fullsized":"2024-08-17T02:27:25.454969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460460+0000","last_change":"2024-08-17T02:27:24.450947+0000","last_active":"2024-08-17T02:27:25.460460+0000","last_peered":"2024-08-17T02:27:25.460460+0000","last_clean":"2024-08-17T02:27:25.460460+0000","last_became_active":"2024-08-17T02:27:24.450649+0000","last_became_peered":"2024-08-17T02:27:24.450649+0000","last_unstale":"2024-08-17T02:27:25.460460+0000","last_undegraded":"2024-08-17T02:27:25.460460+0000","last_fullsized":"2024-08-17T02:27:25.460460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:33.132085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450998+0000","last_change":"2024-08-17T02:27:25.446668+0000","last_active":"2024-08-17T02:27:25.450998+0000","last_peered":"2024-08-17T02:27:25.450998+0000","last_clean":"2024-08-17T02:27:25.450998+0000","last_became_active":"2024-08-17T02:27:25.446347+0000","last_became_peered":"2024-08-17T02:27:25.446347+0000","last_unstale":"2024-08-17T02:27:25.450998+0000","last_undegraded":"2024-08-17T02:27:25.450998+0000","last_fullsized":"2024-08-17T02:27:25.450998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456596+0000","last_change":"2024-08-17T02:27:24.451135+0000","last_active":"2024-08-17T02:27:25.456596+0000","last_peered":"2024-08-17T02:27:25.456596+0000","last_clean":"2024-08-17T02:27:25.456596+0000","last_became_active":"2024-08-17T02:27:24.450804+0000","last_became_peered":"2024-08-17T02:27:24.450804+0000","last_unstale":"2024-08-17T02:27:25.456596+0000","last_undegraded":"2024-08-17T02:27:25.456596+0000","last_fullsized":"2024-08-17T02:27:25.456596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:51.057653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453406+0000","last_change":"2024-08-17T02:27:25.446961+0000","last_active":"2024-08-17T02:27:25.453406+0000","last_peered":"2024-08-17T02:27:25.453406+0000","last_clean":"2024-08-17T02:27:25.453406+0000","last_became_active":"2024-08-17T02:27:25.446547+0000","last_became_peered":"2024-08-17T02:27:25.446547+0000","last_unstale":"2024-08-17T02:27:25.453406+0000","last_undegraded":"2024-08-17T02:27:25.453406+0000","last_fullsized":"2024-08-17T02:27:25.453406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470520+0000","last_change":"2024-08-17T02:27:24.442678+0000","last_active":"2024-08-17T02:27:25.470520+0000","last_peered":"2024-08-17T02:27:25.470520+0000","last_clean":"2024-08-17T02:27:25.470520+0000","last_became_active":"2024-08-17T02:27:24.441192+0000","last_became_peered":"2024-08-17T02:27:24.441192+0000","last_unstale":"2024-08-17T02:27:25.470520+0000","last_undegraded":"2024-08-17T02:27:25.470520+0000","last_fullsized":"2024-08-17T02:27:25.470520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465734+0000","last_change":"2024-08-17T02:27:25.459255+0000","last_active":"2024-08-17T02:27:25.465734+0000","last_peered":"2024-08-17T02:27:25.465734+0000","last_clean":"2024-08-17T02:27:25.465734+0000","last_became_active":"2024-08-17T02:27:25.458944+0000","last_became_peered":"2024-08-17T02:27:25.458944+0000","last_unstale":"2024-08-17T02:27:25.465734+0000","last_undegraded":"2024-08-17T02:27:25.465734+0000","last_fullsized":"2024-08-17T02:27:25.465734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464782+0000","last_change":"2024-08-17T02:27:24.450686+0000","last_active":"2024-08-17T02:27:25.464782+0000","last_peered":"2024-08-17T02:27:25.464782+0000","last_clean":"2024-08-17T02:27:25.464782+0000","last_became_active":"2024-08-17T02:27:24.450410+0000","last_became_peered":"2024-08-17T02:27:24.450410+0000","last_unstale":"2024-08-17T02:27:25.464782+0000","last_undegraded":"2024-08-17T02:27:25.464782+0000","last_fullsized":"2024-08-17T02:27:25.464782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4649999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.964}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4610000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2649999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0019999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3250000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:30.057 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:30.057 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:27:30.057 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:27:30.057 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:27:30.058 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:27:30.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.243+0000 7fb198600640 1 Processor -- start 2024-08-17T02:27:30.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.243+0000 7fb198600640 1 -- start start 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb198600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb190159120 0x7fb1900ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb198600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1900abe30 0x7fb1900aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb198600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1900a96c0 con 0x7fb190158d50 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb198600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900acf00 con 0x7fb190159120 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb198600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1900ac230 con 0x7fb1900abe30 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb195200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb190159120 0x7fb1900ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb195c00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb190158d50 0x7fb1900ac4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37382/0 (socket says 172.21.15.42:37382) 2024-08-17T02:27:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb195c00640 1 -- 172.21.15.42:0/455559129 learned_addr learned my addr 172.21.15.42:0/455559129 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb196600640 1 --2- 172.21.15.42:0/455559129 >> v2:172.21.15.62:3300/0 conn(0x7fb1900abe30 0x7fb1900aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb195200640 1 -- 172.21.15.42:0/455559129 >> v2:172.21.15.62:3300/0 conn(0x7fb1900abe30 msgr2=0x7fb1900aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb195200640 1 --2- 172.21.15.42:0/455559129 >> v2:172.21.15.62:3300/0 conn(0x7fb1900abe30 0x7fb1900aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.245+0000 7fb195200640 1 -- 172.21.15.42:0/455559129 >> v1:172.21.15.42:6789/0 conn(0x7fb190158d50 legacy=0x7fb1900ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.246+0000 7fb195200640 1 -- 172.21.15.42:0/455559129 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900af7d0 con 0x7fb190159120 2024-08-17T02:27:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.246+0000 7fb18fe00640 1 -- 172.21.15.42:0/455559129 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799633645 0 0) 0x7fb1900a96c0 con 0x7fb190158d50 2024-08-17T02:27:30.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb195200640 1 --2- 172.21.15.42:0/455559129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb190159120 0x7fb1900ab8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb19015c9b0 tx=0x7fb17c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec806d6815387cb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb18fe00640 1 -- 172.21.15.42:0/455559129 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c02ad20 con 0x7fb190159120 2024-08-17T02:27:30.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb18fe00640 1 -- 172.21.15.42:0/455559129 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c02ae80 con 0x7fb190159120 2024-08-17T02:27:30.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb18fe00640 1 -- 172.21.15.42:0/455559129 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c032670 con 0x7fb190159120 2024-08-17T02:27:30.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb198600640 1 -- 172.21.15.42:0/455559129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb190159120 msgr2=0x7fb1900ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb198600640 1 --2- 172.21.15.42:0/455559129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb190159120 0x7fb1900ab8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb19015c9b0 tx=0x7fb17c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb198600640 1 -- 172.21.15.42:0/455559129 shutdown_connections 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb198600640 1 --2- 172.21.15.42:0/455559129 >> v2:172.21.15.62:3300/0 conn(0x7fb1900abe30 0x7fb1900aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb198600640 1 --2- 172.21.15.42:0/455559129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb190159120 0x7fb1900ab8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.247+0000 7fb198600640 1 -- 172.21.15.42:0/455559129 >> 172.21.15.42:0/455559129 conn(0x7fb190095a70 msgr2=0x7fb190095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.248+0000 7fb198600640 1 -- 172.21.15.42:0/455559129 shutdown_connections 2024-08-17T02:27:30.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.248+0000 7fb198600640 1 -- 172.21.15.42:0/455559129 wait complete. 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.249+0000 7fb198600640 1 Processor -- start 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.249+0000 7fb198600640 1 -- start start 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb198600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 0x7fb19009a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb198600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb190158d50 0x7fb19015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb198600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb190159120 0x7fb19015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb198600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19016cac0 con 0x7fb1900abe30 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb198600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19016cda0 con 0x7fb190158d50 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb198600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19016d080 con 0x7fb190159120 2024-08-17T02:27:30.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb195c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 0x7fb19009a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb195c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 0x7fb19009a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47896/0 (socket says 172.21.15.42:47896) 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb195c00640 1 -- 172.21.15.42:0/1865001921 learned_addr learned my addr 172.21.15.42:0/1865001921 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb195200640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb190158d50 0x7fb19015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.250+0000 7fb196600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb190159120 0x7fb19015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb195c00640 1 -- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb190159120 msgr2=0x7fb19015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb195c00640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb190159120 0x7fb19015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb195c00640 1 -- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb190158d50 msgr2=0x7fb19015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb195c00640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb190158d50 0x7fb19015b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb195c00640 1 -- 172.21.15.42:0/1865001921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009390 con 0x7fb1900abe30 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb195c00640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 0x7fb19009a120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c5e0 tx=0x7fb184007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184005aa0 con 0x7fb1900abe30 2024-08-17T02:27:30.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184005c00 con 0x7fb1900abe30 2024-08-17T02:27:30.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19016d360 con 0x7fb1900abe30 2024-08-17T02:27:30.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840070f0 con 0x7fb1900abe30 2024-08-17T02:27:30.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.251+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19009a660 con 0x7fb1900abe30 2024-08-17T02:27:30.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.252+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb190063fb0 con 0x7fb1900abe30 2024-08-17T02:27:30.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.253+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb184007520 con 0x7fb1900abe30 2024-08-17T02:27:30.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.254+0000 7fb18cc00640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb170065150 0x7fb170067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.254+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb184081ea0 con 0x7fb1900abe30 2024-08-17T02:27:30.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.254+0000 7fb195200640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb170065150 0x7fb170067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.255+0000 7fb195200640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb170065150 0x7fb170067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb17c034000 tx=0x7fb17c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.257+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb18404fff0 con 0x7fb1900abe30 2024-08-17T02:27:30.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.493+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb19016cc00 con 0x7fb1900abe30 2024-08-17T02:27:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.496+0000 7fb18cc00640 1 -- 172.21.15.42:0/1865001921 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161029 (secure 0 0 0) 0x7fb19016cc00 con 0x7fb1900abe30 2024-08-17T02:27:30.499 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.499+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb170065150 msgr2=0x7fb170067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.499+0000 7fb198600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb170065150 0x7fb170067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb17c034000 tx=0x7fb17c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.499+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 msgr2=0x7fb19009a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.499+0000 7fb198600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 0x7fb19009a120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c5e0 tx=0x7fb184007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.499+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 shutdown_connections 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb170065150 0x7fb170067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb190159120 0x7fb19015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb190158d50 0x7fb19015b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 --2- 172.21.15.42:0/1865001921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1900abe30 0x7fb19009a120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 >> 172.21.15.42:0/1865001921 conn(0x7fb190095a70 msgr2=0x7fb1900aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 shutdown_connections 2024-08-17T02:27:30.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.500+0000 7fb198600640 1 -- 172.21.15.42:0/1865001921 wait complete. 2024-08-17T02:27:30.514 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":36609},{"type":"v1","addr":"172.21.15.42:6833","nonce":36609}]},"active_addr":"172.21.15.42:6833/36609","active_change":"2024-08-17T02:27:11.170592+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":429934007}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":3397600313}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1549907292}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":549554258}]}]} 2024-08-17T02:27:30.517 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:27:30.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:27:30.517 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:30.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.668+0000 7f19b4000640 1 Processor -- start 2024-08-17T02:27:30.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.668+0000 7f19b4000640 1 -- start start 2024-08-17T02:27:30.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.669+0000 7f19b4000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19ac0ca050 0x7f19ac156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.669+0000 7f19b4000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 0x7f19ac15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.669+0000 7f19b4000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac15b5e0 con 0x7f19ac0ad960 2024-08-17T02:27:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.669+0000 7f19b4000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac0cb160 con 0x7f19ac0ca050 2024-08-17T02:27:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.669+0000 7f19b4000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0b0d10 con 0x7f19ac0add30 2024-08-17T02:27:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 0x7f19ac15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b0c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19ac0ca050 0x7f19ac156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 0x7f19ac15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:50436/0 (socket says 172.21.15.42:50436) 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 -- 172.21.15.42:0/3531817332 learned_addr learned my addr 172.21.15.42:0/3531817332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b1600640 1 --1- 172.21.15.42:0/3531817332 >> v1:172.21.15.62:6789/0 conn(0x7f19ac0ad960 0x7f19ac156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:43790/0 (socket says 172.21.15.42:43790) 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 -- 172.21.15.42:0/3531817332 >> v2:172.21.15.62:3300/0 conn(0x7f19ac0ca050 msgr2=0x7f19ac156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 --2- 172.21.15.42:0/3531817332 >> v2:172.21.15.62:3300/0 conn(0x7f19ac0ca050 0x7f19ac156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 -- 172.21.15.42:0/3531817332 >> v1:172.21.15.62:6789/0 conn(0x7f19ac0ad960 legacy=0x7f19ac156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.670+0000 7f19b2000640 1 -- 172.21.15.42:0/3531817332 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0ca550 con 0x7f19ac0add30 2024-08-17T02:27:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.671+0000 7f19b2000640 1 --2- 172.21.15.42:0/3531817332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 0x7f19ac15b0a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009f20 tx=0x7f19a4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4fa792e7c6c99c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.671+0000 7f19abe00640 1 -- 172.21.15.42:0/3531817332 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4032460 con 0x7f19ac0add30 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.671+0000 7f19abe00640 1 -- 172.21.15.42:0/3531817332 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40325c0 con 0x7f19ac0add30 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.671+0000 7f19abe00640 1 -- 172.21.15.42:0/3531817332 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a40329a0 con 0x7f19ac0add30 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 -- 172.21.15.42:0/3531817332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 msgr2=0x7f19ac15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 --2- 172.21.15.42:0/3531817332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 0x7f19ac15b0a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009f20 tx=0x7f19a4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 -- 172.21.15.42:0/3531817332 shutdown_connections 2024-08-17T02:27:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 --2- 172.21.15.42:0/3531817332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0add30 0x7f19ac15b0a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 --2- 172.21.15.42:0/3531817332 >> v2:172.21.15.62:3300/0 conn(0x7f19ac0ca050 0x7f19ac156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 -- 172.21.15.42:0/3531817332 >> 172.21.15.42:0/3531817332 conn(0x7f19ac066e60 msgr2=0x7f19ac067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 -- 172.21.15.42:0/3531817332 shutdown_connections 2024-08-17T02:27:30.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.672+0000 7f19b4000640 1 -- 172.21.15.42:0/3531817332 wait complete. 2024-08-17T02:27:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.673+0000 7f19b4000640 1 Processor -- start 2024-08-17T02:27:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 -- start start 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0ad960 0x7f19ac0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19ac0add30 0x7f19ac150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 0x7f19ac151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1524a0 con 0x7f19ac0ca050 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0abf60 con 0x7f19ac0add30 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.674+0000 7f19b4000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0ac240 con 0x7f19ac0ad960 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 0x7f19ac151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 0x7f19ac151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47902/0 (socket says 172.21.15.42:47902) 2024-08-17T02:27:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 -- 172.21.15.42:0/1649705735 learned_addr learned my addr 172.21.15.42:0/1649705735 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b1600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0ad960 0x7f19ac0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b0c00640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19ac0add30 0x7f19ac150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 -- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0ad960 msgr2=0x7f19ac0acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0ad960 0x7f19ac0acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 -- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19ac0add30 msgr2=0x7f19ac150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19ac0add30 0x7f19ac150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b2000640 1 -- 172.21.15.42:0/1649705735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4009ae0 con 0x7f19ac0ca050 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.675+0000 7f19b1600640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0ad960 0x7f19ac0acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.676+0000 7f19b2000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 0x7f19ac151f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009f20 tx=0x7f19a4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.676+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4032460 con 0x7f19ac0ca050 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.676+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4008e50 con 0x7f19ac0ca050 2024-08-17T02:27:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.676+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a403c640 con 0x7f19ac0ca050 2024-08-17T02:27:30.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.676+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac0ac520 con 0x7f19ac0ca050 2024-08-17T02:27:30.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.676+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac142220 con 0x7f19ac0ca050 2024-08-17T02:27:30.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.677+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac0aca20 con 0x7f19ac0ca050 2024-08-17T02:27:30.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.678+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f19a4039050 con 0x7f19ac0ca050 2024-08-17T02:27:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.679+0000 7f19a8c00640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f198c065150 0x7f198c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.679+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19a40a34b0 con 0x7f19ac0ca050 2024-08-17T02:27:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.679+0000 7f19b1600640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f198c065150 0x7f198c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.679+0000 7f19b1600640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f198c065150 0x7f198c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19a00047a0 tx=0x7f19a0007e20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.683+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f19a4071580 con 0x7f19ac0ca050 2024-08-17T02:27:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.865+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19ac063fb0 con 0x7f19ac0ca050 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.866+0000 7f19a8c00640 1 -- 172.21.15.42:0/1649705735 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f19a4074ba0 con 0x7f19ac0ca050 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:30.866 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:30.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f198c065150 msgr2=0x7f198c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f198c065150 0x7f198c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19a00047a0 tx=0x7f19a0007e20 comp rx=0 tx=0).stop 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 msgr2=0x7f19ac151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 0x7f19ac151f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009f20 tx=0x7f19a4037000 comp rx=0 tx=0).stop 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 shutdown_connections 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f198c065150 0x7f198c067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19ac0ca050 0x7f19ac151f60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19ac0add30 0x7f19ac150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 --2- 172.21.15.42:0/1649705735 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19ac0ad960 0x7f19ac0acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 >> 172.21.15.42:0/1649705735 conn(0x7f19ac066e60 msgr2=0x7f19ac06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 shutdown_connections 2024-08-17T02:27:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:30.868+0000 7f19b4000640 1 -- 172.21.15.42:0/1649705735 wait complete. 2024-08-17T02:27:30.883 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:27:30.883 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:31.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.033+0000 7f4f99200640 1 Processor -- start 2024-08-17T02:27:31.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.033+0000 7f4f99200640 1 -- start start 2024-08-17T02:27:31.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.034+0000 7f4f99200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f941590b0 0x7f4f940b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f99200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940c92b0 con 0x7f4f940afca0 2024-08-17T02:27:31.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f99200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940ad480 con 0x7f4f940acf10 2024-08-17T02:27:31.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f99200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940b0980 con 0x7f4f941590b0 2024-08-17T02:27:31.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f91e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4f940afca0 0x7f4f941589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56542/0 (socket says 172.21.15.42:56542) 2024-08-17T02:27:31.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f91e00640 1 -- 172.21.15.42:0/766335157 learned_addr learned my addr 172.21.15.42:0/766335157 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225281830 0 0) 0x7f4f940c92b0 con 0x7f4f940afca0 2024-08-17T02:27:31.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f91400640 1 --2- 172.21.15.42:0/766335157 >> v2:172.21.15.62:3300/0 conn(0x7f4f941590b0 0x7f4f940b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f780034e0 con 0x7f4f940afca0 2024-08-17T02:27:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655815296 0 0) 0x7f4f780034e0 con 0x7f4f940afca0 2024-08-17T02:27:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 >> v2:172.21.15.62:3300/0 conn(0x7f4f941590b0 msgr2=0x7f4f940b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f90a00640 1 --2- 172.21.15.42:0/766335157 >> v2:172.21.15.62:3300/0 conn(0x7f4f941590b0 0x7f4f940b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.035+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 >> v1:172.21.15.62:6789/0 conn(0x7f4f940acf10 legacy=0x7f4f940c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940ad760 con 0x7f4f940afca0 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f4f84001470 con 0x7f4f940afca0 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 >> v1:172.21.15.42:6789/0 conn(0x7f4f940afca0 legacy=0x7f4f941589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f780039d0 0x7f4f78003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f78004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f78005130 0x7f4f7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7800bfc0 con 0x7f4f78004780 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7800c100 con 0x7f4f780039d0 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7800c2c0 con 0x7f4f78005130 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91400640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f78004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91e00640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f780039d0 0x7f4f78003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f92800640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f78005130 0x7f4f7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91400640 1 -- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f78005130 msgr2=0x7f4f7800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91400640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f78005130 0x7f4f7800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91400640 1 -- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f780039d0 msgr2=0x7f4f78003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91400640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f780039d0 0x7f4f78003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f91400640 1 -- 172.21.15.42:0/766335157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780034e0 con 0x7f4f78004780 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f92800640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f78005130 0x7f4f7800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.036+0000 7f4f92800640 1 -- 172.21.15.42:0/766335157 reap_dead start 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.037+0000 7f4f91400640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f78004bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4f941594f0 tx=0x7f4f800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4315626b55b503d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80031400 con 0x7f4f78004780 2024-08-17T02:27:31.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8002d050 con 0x7f4f78004780 2024-08-17T02:27:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f90a00640 1 -- 172.21.15.42:0/766335157 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80031790 con 0x7f4f78004780 2024-08-17T02:27:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 -- 172.21.15.42:0/766335157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 msgr2=0x7f4f78004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f78004bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4f941594f0 tx=0x7f4f800090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 -- 172.21.15.42:0/766335157 shutdown_connections 2024-08-17T02:27:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 --2- 172.21.15.42:0/766335157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f78004bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 -- 172.21.15.42:0/766335157 >> 172.21.15.42:0/766335157 conn(0x7f4f94066e60 msgr2=0x7f4f94067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 -- 172.21.15.42:0/766335157 shutdown_connections 2024-08-17T02:27:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.038+0000 7f4f99200640 1 -- 172.21.15.42:0/766335157 wait complete. 2024-08-17T02:27:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.040+0000 7f4f99200640 1 Processor -- start 2024-08-17T02:27:31.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.040+0000 7f4f99200640 1 -- start start 2024-08-17T02:27:31.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f99200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f94168c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f99200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f9416c200 0x7f4f9414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f99200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f9413f210 0x7f4f940c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f99200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94169160 con 0x7f4f78004780 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f99200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9414cf50 con 0x7f4f9413f210 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f99200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9416c700 con 0x7f4f9416c200 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f94168c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f94168c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43634/0 (socket says 172.21.15.42:43634) 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 -- 172.21.15.42:0/3036366810 learned_addr learned my addr 172.21.15.42:0/3036366810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f92800640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f9413f210 0x7f4f940c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91400640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f9416c200 0x7f4f9414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 -- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f9416c200 msgr2=0x7f4f9414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f9416c200 0x7f4f9414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 -- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f9413f210 msgr2=0x7f4f940c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f9413f210 0x7f4f940c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91e00640 1 -- 172.21.15.42:0/3036366810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9416c9e0 con 0x7f4f78004780 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f92800640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f9413f210 0x7f4f940c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.041+0000 7f4f91400640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f9416c200 0x7f4f9414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.042+0000 7f4f91e00640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f94168c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f84004ad0 tx=0x7f4f940ad370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.042+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400f960 con 0x7f4f78004780 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.042+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400fae0 con 0x7f4f78004780 2024-08-17T02:27:31.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.042+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400fea0 con 0x7f4f78004780 2024-08-17T02:27:31.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.042+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9416ccc0 con 0x7f4f78004780 2024-08-17T02:27:31.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.042+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9414eca0 con 0x7f4f78004780 2024-08-17T02:27:31.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.043+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94063fb0 con 0x7f4f78004780 2024-08-17T02:27:31.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.044+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4f84013600 con 0x7f4f78004780 2024-08-17T02:27:31.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.045+0000 7f4f89600640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4f74065180 0x7f4f74067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.045+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f84082770 con 0x7f4f78004780 2024-08-17T02:27:31.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.045+0000 7f4f91400640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4f74065180 0x7f4f74067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.046+0000 7f4f91400640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4f74065180 0x7f4f74067630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4f941594f0 tx=0x7f4f80035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.048+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4f84054220 con 0x7f4f78004780 2024-08-17T02:27:31.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.233+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f94067b70 con 0x7f4f78004780 2024-08-17T02:27:31.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.234+0000 7f4f89600640 1 -- 172.21.15.42:0/3036366810 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f4f84008000 con 0x7f4f78004780 2024-08-17T02:27:31.235 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:31.235 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4f74065180 msgr2=0x7f4f74067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4f74065180 0x7f4f74067630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4f941594f0 tx=0x7f4f80035000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 msgr2=0x7f4f94168c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f94168c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f84004ad0 tx=0x7f4f940ad370 comp rx=0 tx=0).stop 2024-08-17T02:27:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 shutdown_connections 2024-08-17T02:27:31.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4f74065180 0x7f4f74067630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f9413f210 0x7f4f940c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f9416c200 0x7f4f9414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 --2- 172.21.15.42:0/3036366810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f78004780 0x7f4f94168c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.236+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 >> 172.21.15.42:0/3036366810 conn(0x7f4f94066e60 msgr2=0x7f4f940cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.237+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 shutdown_connections 2024-08-17T02:27:31.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.237+0000 7f4f99200640 1 -- 172.21.15.42:0/3036366810 wait complete. 2024-08-17T02:27:31.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:27:31.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:27:31.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:27:31.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:27:31.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:27:31.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:27:31.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:27:31.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.526+0000 7f75f3000640 1 Processor -- start 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.526+0000 7f75f3000640 1 -- start start 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.528+0000 7f75f3000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f75ec0d0320 0x7f75ec0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.528+0000 7f75f3000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75ec0ce1f0 0x7f75ec0b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.528+0000 7f75f3000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec0b2ad0 con 0x7f75ec146890 2024-08-17T02:27:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.528+0000 7f75f3000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0cea00 con 0x7f75ec0d0320 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.528+0000 7f75f3000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0cece0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.529+0000 7f75ebe00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75ec146890 0x7f75ec0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:44624/0 (socket says 172.21.15.42:44624) 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.529+0000 7f75ebe00640 1 -- 172.21.15.42:0/1321115389 learned_addr learned my addr 172.21.15.42:0/1321115389 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.529+0000 7f75f1000640 1 --2- 172.21.15.42:0/1321115389 >> v2:172.21.15.62:3300/0 conn(0x7f75ec0ce1f0 0x7f75ec0b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.529+0000 7f75e3400640 1 --2- 172.21.15.42:0/1321115389 >> v2:172.21.15.42:3300/0 conn(0x7f75ec0d0320 0x7f75ec0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.530+0000 7f75eb400640 1 -- 172.21.15.42:0/1321115389 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68759507 0 0) 0x7f75ec0b2ad0 con 0x7f75ec146890 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.530+0000 7f75e3400640 1 -- 172.21.15.42:0/1321115389 >> v2:172.21.15.62:3300/0 conn(0x7f75ec0ce1f0 msgr2=0x7f75ec0b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.530+0000 7f75e3400640 1 --2- 172.21.15.42:0/1321115389 >> v2:172.21.15.62:3300/0 conn(0x7f75ec0ce1f0 0x7f75ec0b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.530+0000 7f75e3400640 1 -- 172.21.15.42:0/1321115389 >> v1:172.21.15.62:6789/0 conn(0x7f75ec146890 legacy=0x7f75ec0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.530+0000 7f75e3400640 1 -- 172.21.15.42:0/1321115389 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0cefc0 con 0x7f75ec0d0320 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.532+0000 7f75e3400640 1 --2- 172.21.15.42:0/1321115389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 0x7f75ec0cdcb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0b5cd0 tx=0x7f75dc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f843ef2e8a9eba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.532+0000 7fe3ee600640 1 Processor -- start 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.532+0000 7f75eb400640 1 -- 172.21.15.42:0/1321115389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc031400 con 0x7f75ec0d0320 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.532+0000 7f75eb400640 1 -- 172.21.15.42:0/1321115389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc02d050 con 0x7f75ec0d0320 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.532+0000 7f75eb400640 1 -- 172.21.15.42:0/1321115389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc031790 con 0x7f75ec0d0320 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.533+0000 7f75f3000640 1 -- 172.21.15.42:0/1321115389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 msgr2=0x7f75ec0cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.533+0000 7f75f3000640 1 --2- 172.21.15.42:0/1321115389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 0x7f75ec0cdcb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0b5cd0 tx=0x7f75dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.534+0000 7f75f3000640 1 -- 172.21.15.42:0/1321115389 shutdown_connections 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.534+0000 7f75f3000640 1 --2- 172.21.15.42:0/1321115389 >> v2:172.21.15.62:3300/0 conn(0x7f75ec0ce1f0 0x7f75ec0b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.533+0000 7fe3ee600640 1 -- start start 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.534+0000 7f75f3000640 1 --2- 172.21.15.42:0/1321115389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 0x7f75ec0cdcb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.535+0000 7f9806400640 1 Processor -- start 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.534+0000 7f75f3000640 1 -- 172.21.15.42:0/1321115389 >> 172.21.15.42:0/1321115389 conn(0x7f75ec06e590 msgr2=0x7f75ec06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.534+0000 7f75f3000640 1 -- 172.21.15.42:0/1321115389 shutdown_connections 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.535+0000 7f75f3000640 1 -- 172.21.15.42:0/1321115389 wait complete. 2024-08-17T02:27:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.535+0000 7f9806400640 1 -- start start 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.536+0000 7fbe41e00640 1 Processor -- start 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7f75f3000640 1 Processor -- start 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7fe3ee600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3e80caf10 0x7fe3e80cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7fe3ee600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7fe3ee600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e80af600 con 0x7fe3e81588d0 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7fe3ee600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80afb60 con 0x7fe3e80caf10 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7fe3ee600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80d04e0 con 0x7fe3e8158ca0 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7f75f3000640 1 -- start start 2024-08-17T02:27:31.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.537+0000 7fbe41e00640 1 -- start start 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7fe3e7e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3e80caf10 0x7fe3e80cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7f9806400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98000ac230 0x7f98000ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7fe3e7e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3e80caf10 0x7fe3e80cf1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:40928/0 (socket says 172.21.15.42:40928) 2024-08-17T02:27:31.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7fe3e7e00640 1 -- 172.21.15.42:0/1485222876 learned_addr learned my addr 172.21.15.42:0/1485222876 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7f9806400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f98000aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7fe3edc00640 1 --2- 172.21.15.42:0/1485222876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7f9805000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98000ac230 0x7f98000ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7f9806400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98001565d0 con 0x7f98001575e0 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7f9806400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9800156820 con 0x7f98000ac230 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7f9806400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9800156b00 con 0x7f98000ab3a0 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7f97ffe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f98000aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7f97ffe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f98000aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35280/0 (socket says 172.21.15.42:35280) 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7f97ffe00640 1 -- 172.21.15.42:0/1311346082 learned_addr learned my addr 172.21.15.42:0/1311346082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fd081e00640 1 Processor -- start 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75f3000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75ec0ce1f0 0x7f75ec16d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fd081e00640 1 -- start start 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fe3edc00640 1 -- 172.21.15.42:0/1485222876 >> v2:172.21.15.62:3300/0 conn(0x7fe3e80caf10 msgr2=0x7fe3e80cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.538+0000 7fe3e7400640 1 -- 172.21.15.42:0/1485222876 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268405079 0 0) 0x7fe3e80af600 con 0x7fe3e81588d0 2024-08-17T02:27:31.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fe3edc00640 1 --2- 172.21.15.42:0/1485222876 >> v2:172.21.15.62:3300/0 conn(0x7fe3e80caf10 0x7fe3e80cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fe3edc00640 1 -- 172.21.15.42:0/1485222876 >> v1:172.21.15.62:6789/0 conn(0x7fe3e81588d0 legacy=0x7fe3e80ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fe3edc00640 1 -- 172.21.15.42:0/1485222876 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80af830 con 0x7fe3e8158ca0 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f97ff400640 1 -- 172.21.15.42:0/1311346082 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135715507 0 0) 0x7f98001565d0 con 0x7f98001575e0 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75f3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 0x7f75ec1419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75ebe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75ec0ce1f0 0x7f75ec16d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75ebe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75ec0ce1f0 0x7f75ec16d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35286/0 (socket says 172.21.15.42:35286) 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f9805000640 1 -- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 msgr2=0x7f98000aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75f3000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ec146890 0x7f75ec141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75f3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec160580 con 0x7f75ec0d0320 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75f3000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec15f900 con 0x7f75ec146890 2024-08-17T02:27:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7f75f3000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec15fbe0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7f9805000640 1 --2- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f98000aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7f9805000640 1 -- 172.21.15.42:0/1311346082 >> v1:172.21.15.62:6789/0 conn(0x7f98001575e0 legacy=0x7f9800157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7f9805000640 1 -- 172.21.15.42:0/1311346082 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800156de0 con 0x7f98000ac230 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7f75ebe00640 1 -- 172.21.15.42:0/1922740229 learned_addr learned my addr 172.21.15.42:0/1922740229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fbe41e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe3c14fe00 0x7fbe3c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.539+0000 7fbe41e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe3c0cca30 0x7fbe3c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe3aa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe3c14fe00 0x7fbe3c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe3a000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbe3c0cca30 0x7fbe3c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe3aa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe3c14fe00 0x7fbe3c0cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:40954/0 (socket says 172.21.15.42:40954) 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe3aa00640 1 -- 172.21.15.42:0/285788971 learned_addr learned my addr 172.21.15.42:0/285788971 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3c0cdef0 con 0x7fbe3c0d0150 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c0af8e0 con 0x7fbe3c0cca30 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.540+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c0d0580 con 0x7fbe3c14fe00 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7fbe3aa00640 1 -- 172.21.15.42:0/285788971 >> v2:172.21.15.42:3300/0 conn(0x7fbe3c0cca30 msgr2=0x7fbe3c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7fbe3aa00640 1 --2- 172.21.15.42:0/285788971 >> v2:172.21.15.42:3300/0 conn(0x7fbe3c0cca30 0x7fbe3c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7fbe3aa00640 1 -- 172.21.15.42:0/285788971 >> v1:172.21.15.62:6789/0 conn(0x7fbe3c0d0150 legacy=0x7fbe3c15cac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:31.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7fbe3aa00640 1 -- 172.21.15.42:0/285788971 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0ccf10 con 0x7fbe3c14fe00 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7f75f1000640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ec146890 0x7f75ec141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7fd081e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0740e1ee0 0x7fd074037f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7fd081e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd074053960 con 0x7fd07404fed0 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7fd081e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd074052d50 con 0x7fd0740e22b0 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7fd081e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd074006790 con 0x7fd0740e1ee0 2024-08-17T02:27:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.541+0000 7f97ffe00640 1 --2- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f98000aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7fe3edc00640 1 --2- 172.21.15.42:0/1485222876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e80cf730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009e60 tx=0x7fe3e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847af1d03549a98f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7fe3e7400640 1 -- 172.21.15.42:0/1485222876 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0007550 con 0x7fe3e8158ca0 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fe3e7400640 1 -- 172.21.15.42:0/1485222876 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e002d050 con 0x7fe3e8158ca0 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fe3e7400640 1 -- 172.21.15.42:0/1485222876 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0007920 con 0x7fe3e8158ca0 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7f75ebe00640 1 -- 172.21.15.42:0/1922740229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ec146890 msgr2=0x7f75ec141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7f75ebe00640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75ec146890 0x7f75ec141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7f75ebe00640 1 -- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 msgr2=0x7f75ec1419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7f75ebe00640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ec0d0320 0x7f75ec1419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.542+0000 7f75ebe00640 1 -- 172.21.15.42:0/1922740229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc009390 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fd07be00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd0740e22b0 0x7fd07404f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:44658/0 (socket says 172.21.15.42:44658) 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fd083400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd07404fed0 0x7fd074007330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56544/0 (socket says 172.21.15.42:56544) 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fd083400640 1 -- 172.21.15.42:0/3672456577 learned_addr learned my addr 172.21.15.42:0/3672456577 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fd080a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0740e1ee0 0x7fd074037f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fbe3aa00640 1 --2- 172.21.15.42:0/285788971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c14fe00 0x7fbe3c0cc4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c088aa0 tx=0x7fbe2c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=291855e154fba37d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7f47ee200640 1 Processor -- start 2024-08-17T02:27:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 -- 172.21.15.42:0/1485222876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 msgr2=0x7fe3e80cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7f75ebe00640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75ec0ce1f0 0x7f75ec16d330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c510 tx=0x7f75d400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 --2- 172.21.15.42:0/1485222876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e80cf730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009e60 tx=0x7fe3e0009780 comp rx=0 tx=0).stop 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7fd07b400640 1 -- 172.21.15.42:0/3672456577 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804377432 0 0) 0x7fd074053960 con 0x7fd07404fed0 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fd07b400640 1 -- 172.21.15.42:0/3672456577 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0640034e0 con 0x7fd07404fed0 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fbe39600640 1 -- 172.21.15.42:0/285788971 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c031400 con 0x7fbe3c14fe00 2024-08-17T02:27:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fbe39600640 1 -- 172.21.15.42:0/285788971 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c02d050 con 0x7fbe3c14fe00 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fbe39600640 1 -- 172.21.15.42:0/285788971 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c0317d0 con 0x7fbe3c14fe00 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 -- 172.21.15.42:0/1485222876 shutdown_connections 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fd080a00640 1 -- 172.21.15.42:0/3672456577 >> v1:172.21.15.62:6789/0 conn(0x7fd0740e22b0 legacy=0x7fd07404f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fd080a00640 1 -- 172.21.15.42:0/3672456577 >> v1:172.21.15.42:6789/0 conn(0x7fd07404fed0 legacy=0x7fd074007330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fd080a00640 1 -- 172.21.15.42:0/3672456577 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074053030 con 0x7fd0740e1ee0 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 --2- 172.21.15.42:0/1485222876 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e80cf730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 --2- 172.21.15.42:0/1485222876 >> v2:172.21.15.62:3300/0 conn(0x7fe3e80caf10 0x7fe3e80cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 -- 172.21.15.42:0/1485222876 >> 172.21.15.42:0/1485222876 conn(0x7fe3e8087a80 msgr2=0x7fe3e806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4005aa0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4005c00 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40070d0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7f9805000640 1 --2- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98000ac230 0x7f98000ac600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009850 tx=0x7f97f40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce872bcede99997 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 -- 172.21.15.42:0/1485222876 shutdown_connections 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.543+0000 7f47ee200640 1 -- start start 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7f97ff400640 1 -- 172.21.15.42:0/1311346082 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f402ad00 con 0x7f98000ac230 2024-08-17T02:27:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f97ff400640 1 -- 172.21.15.42:0/1311346082 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f402ae60 con 0x7f98000ac230 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.544+0000 7fe3ee600640 1 -- 172.21.15.42:0/1485222876 wait complete. 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f97ff400640 1 -- 172.21.15.42:0/1311346082 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f402ad00 con 0x7f98000ac230 2024-08-17T02:27:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f47ee200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f47e80ca880 0x7f47e8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec15fec0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec0c83c0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f47ee200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e8158120 con 0x7f47e81566a0 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f47ee200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80cadc0 con 0x7f47e80c87f0 2024-08-17T02:27:31.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7f47ee200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e8157ed0 con 0x7f47e80ca880 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fd080a00640 1 --2- 172.21.15.42:0/3672456577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0740e1ee0 0x7fd074037f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd070009870 tx=0x7fd0700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4ffef8ca9beb47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7f9806400640 1 -- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98000ac230 msgr2=0x7f98000ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7f9806400640 1 --2- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98000ac230 0x7f98000ac600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009850 tx=0x7f97f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75c4000fd0 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fe3ee600640 1 Processor -- start 2024-08-17T02:27:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c14fe00 msgr2=0x7fbe3c0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7f47ece00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f47e81566a0 0x7f47e80c80e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56560/0 (socket says 172.21.15.42:56560) 2024-08-17T02:27:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7f47ece00640 1 -- 172.21.15.42:0/2240642423 learned_addr learned my addr 172.21.15.42:0/2240642423 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7fe3ee600640 1 -- start start 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f9806400640 1 -- 172.21.15.42:0/1311346082 shutdown_connections 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f9806400640 1 --2- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f98000aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f9806400640 1 --2- 172.21.15.42:0/1311346082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98000ac230 0x7f98000ac600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f9806400640 1 -- 172.21.15.42:0/1311346082 >> 172.21.15.42:0/1311346082 conn(0x7f98000cb780 msgr2=0x7f98000cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.545+0000 7fbe41e00640 1 --2- 172.21.15.42:0/285788971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c14fe00 0x7fbe3c0cc4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c088aa0 tx=0x7fbe2c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47ed800640 1 --2- 172.21.15.42:0/2240642423 >> v2:172.21.15.62:3300/0 conn(0x7f47e80ca880 0x7f47e8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218794973 0 0) 0x7f47e80cadc0 con 0x7f47e80c87f0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47cc0078f0 con 0x7f47e80c87f0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160198877 0 0) 0x7f47e8158120 con 0x7f47e81566a0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e80cadc0 con 0x7f47e81566a0 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47ed800640 1 -- 172.21.15.42:0/2240642423 >> v1:172.21.15.62:6789/0 conn(0x7f47e80c87f0 legacy=0x7f47e80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47ed800640 1 -- 172.21.15.42:0/2240642423 >> v1:172.21.15.42:6789/0 conn(0x7f47e81566a0 legacy=0x7f47e80c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7f47ed800640 1 -- 172.21.15.42:0/2240642423 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80cb910 con 0x7f47e80ca880 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.548+0000 7f9806400640 1 -- 172.21.15.42:0/1311346082 shutdown_connections 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7fd07b400640 1 -- 172.21.15.42:0/3672456577 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07002adf0 con 0x7fd0740e1ee0 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7fd07b400640 1 -- 172.21.15.42:0/3672456577 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd070032440 con 0x7fd0740e1ee0 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.547+0000 7fd07b400640 1 -- 172.21.15.42:0/3672456577 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070032820 con 0x7fd0740e1ee0 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 shutdown_connections 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fbe41e00640 1 --2- 172.21.15.42:0/285788971 >> v2:172.21.15.42:3300/0 conn(0x7fbe3c0cca30 0x7fbe3c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fbe41e00640 1 --2- 172.21.15.42:0/285788971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c14fe00 0x7fbe3c0cc4f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 >> 172.21.15.42:0/285788971 conn(0x7fbe3c068680 msgr2=0x7fbe3c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 shutdown_connections 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.546+0000 7fbe41e00640 1 -- 172.21.15.42:0/285788971 wait complete. 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.548+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f75d4007500 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.549+0000 7fe3ee600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e80caf10 0x7fe3e80c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.548+0000 7f9806400640 1 -- 172.21.15.42:0/1311346082 wait complete. 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.549+0000 7fe3ee600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e81588d0 0x7fe3e81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.549+0000 7fd081e00640 1 -- 172.21.15.42:0/3672456577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0740e1ee0 msgr2=0x7fd074037f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.549+0000 7fd081e00640 1 --2- 172.21.15.42:0/3672456577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0740e1ee0 0x7fd074037f20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd070009870 tx=0x7fd0700090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.549+0000 7fbe41e00640 1 Processor -- start 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fd081e00640 1 -- 172.21.15.42:0/3672456577 shutdown_connections 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fd081e00640 1 --2- 172.21.15.42:0/3672456577 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0740e1ee0 0x7fd074037f20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fd081e00640 1 -- 172.21.15.42:0/3672456577 >> 172.21.15.42:0/3672456577 conn(0x7fd074051bf0 msgr2=0x7fd074051ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fbe41e00640 1 -- start start 2024-08-17T02:27:31.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e81588d0 0x7fe3e81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ee600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e8160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ee600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80b3e90 con 0x7fe3e81588d0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ee600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80b3b90 con 0x7fe3e80caf10 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ee600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80c9260 con 0x7fe3e8158ca0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ed200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e80caf10 0x7fe3e80c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ed200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e80caf10 0x7fe3e80c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:40972/0 (socket says 172.21.15.42:40972) 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fe3ed200640 1 -- 172.21.15.42:0/515832532 learned_addr learned my addr 172.21.15.42:0/515832532 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7f9806400640 1 Processor -- start 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7f75e3e00640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f75c8065220 0x7f75c80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fd081e00640 1 -- 172.21.15.42:0/3672456577 shutdown_connections 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7fd081e00640 1 -- 172.21.15.42:0/3672456577 wait complete. 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7f9806400640 1 -- start start 2024-08-17T02:27:31.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.550+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f75d4082060 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c0cca30 0x7fbe3c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7f75e3e00640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7f75c806d430 0x7f75c806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 --> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75c806fef0 con 0x7f75c806d430 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75d4082350 con 0x7f75ec0ce1f0 2024-08-17T02:27:31.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7f47ed800640 1 --2- 172.21.15.42:0/2240642423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 0x7f47e8156a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009880 tx=0x7f47d80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5b8432d31a6292f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c0d0150 0x7fbe3c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe3c14fe00 0x7fbe3c140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe41e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c0b2670 con 0x7fbe3c0d0150 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe41e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c150270 con 0x7fbe3c0cca30 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe41e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c150550 con 0x7fbe3c14fe00 2024-08-17T02:27:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fe3edc00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e8160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fe3e7e00640 1 -- 172.21.15.42:0/515832532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 msgr2=0x7fe3e8160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fe3e7e00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3e8158ca0 0x7fe3e8160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fe3e7e00640 1 -- 172.21.15.42:0/515832532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e80caf10 msgr2=0x7fe3e80c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fe3e7e00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3e80caf10 0x7fe3e80c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fe3e7e00640 1 -- 172.21.15.42:0/515832532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0009a20 con 0x7fe3e81588d0 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe3c14fe00 0x7fbe3c140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe3c14fe00 0x7fbe3c140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35322/0 (socket says 172.21.15.42:35322) 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d802add0 con 0x7f47e80ca880 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7fbe3b400640 1 -- 172.21.15.42:0/2214845 learned_addr learned my addr 172.21.15.42:0/2214845 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.551+0000 7f75e3400640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f75c8065220 0x7f75c80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3aa00640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c0cca30 0x7fbe3c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8032440 con 0x7f47e80ca880 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7f47e7400640 1 -- 172.21.15.42:0/2240642423 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d802add0 con 0x7f47e80ca880 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7f75f1000640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7f75c806d430 0x7f75c806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3b400640 1 -- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c0cca30 msgr2=0x7fbe3c152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3b400640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe3c0cca30 0x7fbe3c152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3b400640 1 -- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c0d0150 msgr2=0x7fbe3c150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3b400640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe3c0d0150 0x7fbe3c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3b400640 1 -- 172.21.15.42:0/2214845 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c009ae0 con 0x7fbe3c14fe00 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fd081e00640 1 Processor -- start 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7f9806400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f980014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fbe3b400640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe3c14fe00 0x7fbe3c140690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400b4f0 tx=0x7fbe240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fd081e00640 1 -- start start 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400f510 con 0x7fbe3c14fe00 2024-08-17T02:27:31.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f9806400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000ac230 0x7f980014e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f9806400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98001575e0 0x7f980014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f9806400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980014ec60 con 0x7f98000ac230 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f9806400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980014ef40 con 0x7f98001575e0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f9806400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980014f220 con 0x7f98000ab3a0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.552+0000 7fe3e7e00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e81588d0 0x7fe3e81516b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00e990 tx=0x7fe3dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc00c940 con 0x7fe3e81588d0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc00caa0 con 0x7fe3e81588d0 2024-08-17T02:27:31.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc00ce60 con 0x7fe3e81588d0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e80c9540 con 0x7fe3e81588d0 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f47ee200640 1 -- 172.21.15.42:0/2240642423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 msgr2=0x7f47e8156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7f47ee200640 1 --2- 172.21.15.42:0/2240642423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 0x7f47e8156a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009880 tx=0x7f47d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7fd081e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd07404fed0 0x7fd0740c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7fd081e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0740e1ee0 0x7fd0740e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7fd081e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0740e22b0 0x7fd07404ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2400f670 con 0x7fbe3c14fe00 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400fa10 con 0x7fbe3c14fe00 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c150830 con 0x7fbe3c14fe00 2024-08-17T02:27:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c1512c0 con 0x7fbe3c14fe00 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.553+0000 7f75f1000640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7f75c806d430 0x7f75c806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7f75e3400640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f75c8065220 0x7f75c80676d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75dc034000 tx=0x7f75dc035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== osd.2 v2:172.21.15.42:6808/36875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f75c806fef0 con 0x7f75c806d430 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd07be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0740e1ee0 0x7fd0740e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd080a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd07404fed0 0x7fd0740c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd080a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd07404fed0 0x7fd0740c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35338/0 (socket says 172.21.15.42:35338) 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd080a00640 1 -- 172.21.15.42:0/3961114952 learned_addr learned my addr 172.21.15.42:0/3961114952 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd083400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0740e22b0 0x7fd07404ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7f47ee200640 1 -- 172.21.15.42:0/2240642423 shutdown_connections 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7f47ee200640 1 --2- 172.21.15.42:0/2240642423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 0x7f47e8156a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.554+0000 7f47ee200640 1 -- 172.21.15.42:0/2240642423 >> 172.21.15.42:0/2240642423 conn(0x7f47e806b7c0 msgr2=0x7f47e806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fbb07e00640 1 Processor -- start 2024-08-17T02:27:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07404cda0 con 0x7fd0740e22b0 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e8163040 con 0x7fe3e81588d0 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f9805000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f980014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f9805000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f980014fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35336/0 (socket says 172.21.15.42:35336) 2024-08-17T02:27:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f9805000640 1 -- 172.21.15.42:0/2716937332 learned_addr learned my addr 172.21.15.42:0/2716937332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07404c4f0 con 0x7fd0740e1ee0 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0740d3920 con 0x7fd07404fed0 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f47ee200640 1 -- 172.21.15.42:0/2240642423 shutdown_connections 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7fbb07e00640 1 -- start start 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f9805a00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98001575e0 0x7f980014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f97ffe00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000ac230 0x7f980014e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fd083400640 1 -- 172.21.15.42:0/3961114952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd07404fed0 msgr2=0x7fd0740c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3e8070720 con 0x7fe3e81588d0 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7f9805000640 1 -- 172.21.15.42:0/2716937332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98001575e0 msgr2=0x7f980014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7f9805000640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98001575e0 0x7f980014b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7f9805000640 1 -- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000ac230 msgr2=0x7f980014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe2401a3b0 con 0x7fbe3c14fe00 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe3c1503e0 con 0x7fbe3c14fe00 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7f9805000640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000ac230 0x7f980014e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7f9805000640 1 -- 172.21.15.42:0/2716937332 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec009450 con 0x7f98000ab3a0 2024-08-17T02:27:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7f97ffe00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98000ac230 0x7f980014e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fd083400640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd07404fed0 0x7fd0740c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fd083400640 1 -- 172.21.15.42:0/3961114952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0740e1ee0 msgr2=0x7fd0740e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fd083400640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0740e1ee0 0x7fd0740e3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fd083400640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070009330 con 0x7fd0740e22b0 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.556+0000 7fd083400640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0740e22b0 0x7fd07404ea50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd07c000b60 tx=0x7fd07c064990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c06f1c0 con 0x7fd0740e22b0 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c06f380 con 0x7fd0740e22b0 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c08e550 con 0x7fd0740e22b0 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.555+0000 7f47ee200640 1 -- 172.21.15.42:0/2240642423 wait complete. 2024-08-17T02:27:31.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7f47ee200640 1 Processor -- start 2024-08-17T02:27:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7fbe32000640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe18065220 0x7fbe180676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7f47ee200640 1 -- start start 2024-08-17T02:27:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe24081850 con 0x7fbe3c14fe00 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7f9805000640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f980014fd00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009850 tx=0x7f97f4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7fbe32000640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7fbe1806d430 0x7fbe1806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 --> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe1806fef0 con 0x7fbe1806d430 2024-08-17T02:27:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe24083db0 con 0x7fbe3c14fe00 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f403d700 con 0x7f98000ab3a0 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f403d860 con 0x7f98000ab3a0 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.558+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f403d700 con 0x7f98000ab3a0 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.559+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f4009390 con 0x7f98000ab3a0 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.559+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980014f7e0 con 0x7f98000ab3a0 2024-08-17T02:27:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.559+0000 7fbe3a000640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7fbe1806d430 0x7fbe1806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.560+0000 7f47ee200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e80c87f0 0x7f47e80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fd080a00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd07404fed0 0x7fd0740c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0740d3bd0 con 0x7fd0740e22b0 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.557+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0740d4190 con 0x7fd0740e22b0 2024-08-17T02:27:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.560+0000 7fbe3aa00640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe18065220 0x7fbe180676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.560+0000 7fbe3a000640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7fbe1806d430 0x7fbe1806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7f47ece00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e80c87f0 0x7f47e80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb07e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb0806d810 0x7fbb0806dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb07e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb081587e0 0x7fbb080ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7f47ece00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e80c87f0 0x7f47e80b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35342/0 (socket says 172.21.15.42:35342) 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.560+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3dc013680 con 0x7fe3e81588d0 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fe3dbe00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3c8065220 0x7fe3c80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3dc08b3a0 con 0x7fe3e81588d0 2024-08-17T02:27:31.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fe3dbe00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7fe3c806d430 0x7fe3c806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 --> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3c806fef0 con 0x7fe3c806d430 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3dc08b6a0 con 0x7fe3e81588d0 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98000008d0 con 0x7f98000ab3a0 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7f47ee200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 0x7f47e80c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb06a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb0806d810 0x7fbb0806dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb07e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb080abfe0 con 0x7fbb080abba0 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb07e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb08155430 con 0x7fbb0806d810 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb07400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbb080abba0 0x7fbb081545c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:44666/0 (socket says 172.21.15.42:44666) 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb07400640 1 -- 172.21.15.42:0/3079642878 learned_addr learned my addr 172.21.15.42:0/3079642878 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbb06a00640 1 --2- 172.21.15.42:0/3079642878 >> v2:172.21.15.42:3300/0 conn(0x7fbb0806d810 0x7fbb0806dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43700/0 (socket says 172.21.15.42:43700) 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb06000640 1 --2- 172.21.15.42:0/3079642878 >> v2:172.21.15.62:3300/0 conn(0x7fbb081587e0 0x7fbb080ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb07e00640 1 -- 172.21.15.42:0/3079642878 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb08155710 con 0x7fbb081587e0 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fe3ed200640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3c8065220 0x7fe3c80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537848873 0 0) 0x7fbb080abfe0 con 0x7fbb080abba0 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== osd.4 v2:172.21.15.62:6800/37389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbe1806fef0 con 0x7fbe1806d430 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7f47ece00640 1 -- 172.21.15.42:0/1429231280 learned_addr learned my addr 172.21.15.42:0/1429231280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaec0034e0 con 0x7fbb080abba0 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371298018 0 0) 0x7fbaec0034e0 con 0x7fbb080abba0 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 >> v2:172.21.15.62:3300/0 conn(0x7fbb081587e0 msgr2=0x7fbb080ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 --2- 172.21.15.42:0/3079642878 >> v2:172.21.15.62:3300/0 conn(0x7fbb081587e0 0x7fbb080ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 >> v2:172.21.15.42:3300/0 conn(0x7fbb0806d810 msgr2=0x7fbb0806dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 --2- 172.21.15.42:0/3079642878 >> v2:172.21.15.42:3300/0 conn(0x7fbb0806d810 0x7fbb0806dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb081559f0 con 0x7fbb080abba0 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fbb00005130 con 0x7fbb080abba0 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 >> v1:172.21.15.62:6789/0 conn(0x7fbb080abba0 legacy=0x7fbb081545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaec003ac0 0x7fbaec003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbaec004780 0x7fbaec004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbaec00ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08155430 con 0x7fbaec003ac0 2024-08-17T02:27:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08155710 con 0x7fbaec005250 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec010760 con 0x7fbaec004780 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbe3aa00640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe18065220 0x7fbe180676d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c033000 tx=0x7fbe2c036000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7f47e7e00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 0x7f47e80c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7f47ee200640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47e81566a0 0x7f47e80cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb06a00640 1 --2- 172.21.15.42:0/3079642878 >> v2:172.21.15.42:3300/0 conn(0x7fbb0806d810 0x7fbb0806dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7fbb07400640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbaec00ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7f9866400640 1 Processor -- start 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.563+0000 7f9866400640 1 -- start start 2024-08-17T02:27:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7f47ed800640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47e81566a0 0x7f47e80cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7fe3edc00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7fe3c806d430 0x7fe3c806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7fe3ed200640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3c8065220 0x7fe3c80676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4007fd0 tx=0x7fe3d4007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97f4039040 con 0x7f98000ab3a0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e814cc70 con 0x7f47e81566a0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80cc5d0 con 0x7f47e80ca880 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80cd110 con 0x7f47e80c87f0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.561+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd07c08e980 con 0x7fd0740e22b0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.562+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd058000fd0 con 0x7fd0740e22b0 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.565+0000 7f47ece00640 1 -- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 msgr2=0x7f47e80c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.565+0000 7f47ece00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e80ca880 0x7f47e80c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.565+0000 7f9866400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9860158a20 0x7f98600a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f9866400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f9866400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98600aed90 con 0x7f9860158df0 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f9866400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98600af070 con 0x7f9860158a20 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f9866400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98600af350 con 0x7f98600ae860 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.565+0000 7f47ece00640 1 -- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47e81566a0 msgr2=0x7f47e80cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7fbb06000640 1 --2- 172.21.15.42:0/3079642878 >> v2:172.21.15.62:3300/0 conn(0x7fbb081587e0 0x7fbb080ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.564+0000 7fbb06a00640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaec003ac0 0x7fbaec003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f985f400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9860158a20 0x7f98600a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7fbb06000640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbaec004780 0x7fbaec004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f97f3e00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f97e0065230 0x7f97e00676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97f40a1a60 con 0x7f98000ab3a0 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f97f3e00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7f97e006d3c0 0x7f97e006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 --> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97e006fe80 con 0x7f97e006d3c0 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f985f400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9860158a20 0x7f98600a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41044/0 (socket says 172.21.15.42:41044) 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f985f400640 1 -- 172.21.15.42:0/572812952 learned_addr learned my addr 172.21.15.42:0/572812952 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f47ece00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47e81566a0 0x7f47e80cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f47ece00640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009390 con 0x7f47e80c87f0 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7fbb07400640 1 -- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbaec004780 msgr2=0x7fbaec004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7fbb07400640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbaec004780 0x7fbaec004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7fbb07400640 1 -- 172.21.15.42:0/3079642878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaec003ac0 msgr2=0x7fbaec003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7fd06fe00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd05c06da30 0x7fd05c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f47ed800640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47e81566a0 0x7f47e80cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7f9857e00640 1 --2- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f985f400640 1 -- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 msgr2=0x7f986006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f985f400640 1 --2- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f985f400640 1 -- 172.21.15.42:0/572812952 >> v1:172.21.15.62:6789/0 conn(0x7f9860158df0 legacy=0x7f986015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f985f400640 1 -- 172.21.15.42:0/572812952 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600af630 con 0x7f9860158a20 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f47ece00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e80c87f0 0x7f47e80b2f80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c510 tx=0x7f47e0007ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f97ffe00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f97e0065230 0x7f97e00676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0005aa0 con 0x7f47e80c87f0 2024-08-17T02:27:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7f9805a00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7f97e006d3c0 0x7f97e006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd07c0f8940 con 0x7fd0740e22b0 2024-08-17T02:27:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.566+0000 7fe3edc00640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7fe3c806d430 0x7fe3c806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0005c00 con 0x7f47e80c87f0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e00070d0 con 0x7f47e80c87f0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e80cc7e0 con 0x7f47e80c87f0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e80ccda0 con 0x7f47e80c87f0 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7fbb07400640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaec003ac0 0x7fbaec003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.567+0000 7fbb07400640 1 -- 172.21.15.42:0/3079642878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec0034e0 con 0x7fbaec005250 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f985f400640 1 --2- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158a20 0x7f98600a89c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9850009910 tx=0x7f98500091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c433ae882943650e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f985ea00640 1 -- 172.21.15.42:0/572812952 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985002ae40 con 0x7f9860158a20 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7fd06fe00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7fd05c075c40 0x7fd05c078050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.569+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== osd.0 v2:172.21.15.42:6800/36872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe3c806fef0 con 0x7fe3c806d430 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.569+0000 7f97ffe00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f97e0065230 0x7f97e00676e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f980016a490 tx=0x7f97ec0091d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.569+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97f406fb30 con 0x7f98000ab3a0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd05c078700 con 0x7fd05c075c40 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.569+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd07c0fd240 con 0x7fd0740e22b0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7fd080a00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd05c06da30 0x7fd05c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7fbb06a00640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbaec003ac0 0x7fbaec003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fbb07400640 1 -- 172.21.15.42:0/3079642878 reap_dead start 2024-08-17T02:27:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f985ea00640 1 -- 172.21.15.42:0/572812952 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850032440 con 0x7f9860158a20 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.568+0000 7f985ea00640 1 -- 172.21.15.42:0/572812952 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985002ae40 con 0x7f9860158a20 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fd07be00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7fd05c075c40 0x7fd05c078050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7f9866400640 1 -- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158a20 msgr2=0x7f98600a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7f9866400640 1 --2- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158a20 0x7f98600a89c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9850009910 tx=0x7f98500091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fbb07400640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbaec00ffe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c5f0 tx=0x7fbb00007a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ba3700d3fad528 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fd080a00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd05c06da30 0x7fd05c06fee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd070009130 tx=0x7fd070032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0002e420 con 0x7fbaec005250 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0002e580 con 0x7fbaec005250 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.570+0000 7fbb05600640 1 -- 172.21.15.42:0/3079642878 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0002e920 con 0x7fbaec005250 2024-08-17T02:27:31.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47e8070720 con 0x7f47e80c87f0 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7fd07be00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7fd05c075c40 0x7fd05c078050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47e00074c0 con 0x7f47e80c87f0 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f9805a00640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7f97e006d3c0 0x7f97e006f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7fbb07e00640 1 -- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 msgr2=0x7fbaec00ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7fbb07e00640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbaec00ffe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c5f0 tx=0x7fbb00007a90 comp rx=0 tx=0).stop 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f9866400640 1 -- 172.21.15.42:0/572812952 shutdown_connections 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f9866400640 1 --2- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f9866400640 1 --2- 172.21.15.42:0/572812952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158a20 0x7f98600a89c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.571+0000 7f9866400640 1 -- 172.21.15.42:0/572812952 >> 172.21.15.42:0/572812952 conn(0x7f9860066e60 msgr2=0x7f9860067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7fbb07e00640 1 -- 172.21.15.42:0/3079642878 shutdown_connections 2024-08-17T02:27:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f9866400640 1 -- 172.21.15.42:0/572812952 shutdown_connections 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7fbb07e00640 1 --2- 172.21.15.42:0/3079642878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbaec00ffe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7fbb07e00640 1 -- 172.21.15.42:0/3079642878 >> 172.21.15.42:0/3079642878 conn(0x7fbb08066e60 msgr2=0x7fbb08067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7fbb07e00640 1 -- 172.21.15.42:0/3079642878 shutdown_connections 2024-08-17T02:27:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f47dfe00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f47c4065250 0x7f47c4067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47e0081960 con 0x7f47e80c87f0 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f47dfe00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7f47c406d460 0x7f47c406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47c406ff20 con 0x7f47c406d460 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47e0086220 con 0x7f47e80c87f0 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f47e7e00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f47c4065250 0x7f47c4067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.573+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== osd.3 v2:172.21.15.42:6816/36876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd05c078700 con 0x7fd05c075c40 2024-08-17T02:27:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.573+0000 7f47ed800640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7f47c406d460 0x7f47c406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7fbb07e00640 1 -- 172.21.15.42:0/3079642878 wait complete. 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.572+0000 7f9866400640 1 -- 172.21.15.42:0/572812952 wait complete. 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.574+0000 7f9866400640 1 Processor -- start 2024-08-17T02:27:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.574+0000 7f9866400640 1 -- start start 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.573+0000 7f47ed800640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7f47c406d460 0x7f47c406f870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.574+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== osd.5 v2:172.21.15.62:6808/37390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f47c406ff20 con 0x7f47c406d460 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.576+0000 7fbb07e00640 1 Processor -- start 2024-08-17T02:27:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.576+0000 7f47e7e00640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f47c4065250 0x7f47c4067700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47d0007fd0 tx=0x7f47d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.576+0000 7f9866400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.576+0000 7f9866400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9860158a20 0x7f986015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7fbb07e00640 1 -- start start 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f985f400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f985f400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35376/0 (socket says 172.21.15.42:35376) 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f9866400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158df0 0x7f986016bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f985f400640 1 -- 172.21.15.42:0/2693596871 learned_addr learned my addr 172.21.15.42:0/2693596871 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986015c610 con 0x7f9860158a20 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986014bcb0 con 0x7f9860158df0 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.577+0000 7f985fe00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158df0 0x7f986016bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.578+0000 7f9857e00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9860158a20 0x7f986015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.578+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986014b0a0 con 0x7f98600ae860 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.578+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== osd.1 v2:172.21.15.42:6824/36874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f97e006fe80 con 0x7f97e006d3c0 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f985f400640 1 -- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158df0 msgr2=0x7f986016bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f985f400640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9860158df0 0x7f986016bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f985f400640 1 -- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9860158a20 msgr2=0x7f986015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f985f400640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9860158a20 0x7f986015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f985f400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009450 con 0x7f98600ae860 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f985f400640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986014aa70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9850035040 tx=0x7f9850032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850031a60 con 0x7f98600ae860 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850031bc0 con 0x7f98600ae860 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985003d420 con 0x7f98600ae860 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986014b380 con 0x7f98600ae860 2024-08-17T02:27:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986014b940 con 0x7f98600ae860 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.579+0000 7fbb07e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbb081539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7fbb07e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb080a7ba0 0x7fbb080a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7fbb07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb08165b00 0x7fbb08165f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7fbb07e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08153f30 con 0x7fbb08165b00 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7fbb07e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb080a8530 con 0x7fbaec005250 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.580+0000 7fbb07e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08152950 con 0x7fbb080a7ba0 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbb081539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbb081539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41066/0 (socket says 172.21.15.42:41066) 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06a00640 1 -- 172.21.15.42:0/3790675573 learned_addr learned my addr 172.21.15.42:0/3790675573 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06000640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb080a7ba0 0x7fbb080a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb07400640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb08165b00 0x7fbb08165f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06000640 1 -- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 msgr2=0x7fbb081539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06000640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbaec005250 0x7fbb081539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06000640 1 -- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb08165b00 msgr2=0x7fbb08165f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06000640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb08165b00 0x7fbb08165f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7fbb06000640 1 -- 172.21.15.42:0/3790675573 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08152c30 con 0x7fbb080a7ba0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.582+0000 7fbb06000640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb080a7ba0 0x7fbb080a7ff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e930 tx=0x7fbaf4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.582+0000 7fbb07400640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb08165b00 0x7fbb08165f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.582+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400a710 con 0x7fbb080a7ba0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.582+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400a870 con 0x7fbb080a7ba0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.582+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400ac30 con 0x7fbb080a7ba0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.583+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08152f10 con 0x7fbb080a7ba0 2024-08-17T02:27:31.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.583+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb081534d0 con 0x7fbb080a7ba0 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.581+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9860063fb0 con 0x7f98600ae860 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.583+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9850039040 con 0x7f98600ae860 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.584+0000 7f9856a00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f983c0652a0 0x7f983c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.585+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb08070720 con 0x7fbb080a7ba0 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.584+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f985002ae40 con 0x7f98600ae860 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.585+0000 7f9856a00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f983c06d430 0x7f983c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.585+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f983c06fef0 con 0x7f983c06d430 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.585+0000 7f9857e00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f983c0652a0 0x7f983c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.585+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9850070740 con 0x7f98600ae860 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.585+0000 7f985fe00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f983c06d430 0x7f983c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.586+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbaf4015480 con 0x7fbb080a7ba0 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.586+0000 7f985fe00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f983c06d430 0x7f983c06f840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.586+0000 7f9857e00640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f983c0652a0 0x7f983c067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f986015bd40 tx=0x7f9848017040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.586+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 --> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75c4002ca0 con 0x7f75c806d430 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.587+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== osd.7 v2:172.21.15.62:6816/37391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f983c06fef0 con 0x7f983c06d430 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.587+0000 7fbafe000640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbae80652a0 0x7fbae8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.587+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaf4082ff0 con 0x7fbb080a7ba0 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.588+0000 7fbafe000640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fbae806d4b0 0x7fbae806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.588+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 --> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbae806ff70 con 0x7fbae806d4b0 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.588+0000 7f75e3e00640 1 -- 172.21.15.42:0/1922740229 <== osd.2 v2:172.21.15.42:6808/36875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75c4002ca0 con 0x7f75c806d430 2024-08-17T02:27:31.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.588+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf4085590 con 0x7fbb080a7ba0 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.588+0000 7fbb07400640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fbae806d4b0 0x7fbae806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7f75c806d430 msgr2=0x7f75c806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7f75f3000640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7f75c806d430 0x7f75c806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f75c8065220 msgr2=0x7f75c80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7f75f3000640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f75c8065220 0x7f75c80676d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f75dc034000 tx=0x7f75dc035000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75ec0ce1f0 msgr2=0x7f75ec16d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7f75f3000640 1 --2- 172.21.15.42:0/1922740229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f75ec0ce1f0 0x7f75ec16d330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c510 tx=0x7f75d400c910 comp rx=0 tx=0).stop 2024-08-17T02:27:31.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7fbb06a00640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbae80652a0 0x7fbae8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.589+0000 7fbb07400640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fbae806d4b0 0x7fbae806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.590+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== osd.6 v2:172.21.15.62:6824/37406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbae806ff70 con 0x7fbae806d4b0 2024-08-17T02:27:31.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.590+0000 7fbb06a00640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbae80652a0 0x7fbae8067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8003000 tx=0x7fbaf8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.591+0000 7f75f1000640 1 -- 172.21.15.42:0/1922740229 reap_dead start 2024-08-17T02:27:31.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.591+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 shutdown_connections 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.591+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 >> 172.21.15.42:0/1922740229 conn(0x7f75ec06e590 msgr2=0x7f75ec0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.593+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 --> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe3c1509c0 con 0x7fbe1806d430 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.593+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 shutdown_connections 2024-08-17T02:27:31.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.593+0000 7f75f3000640 1 -- 172.21.15.42:0/1922740229 wait complete. 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.594+0000 7fbe32000640 1 -- 172.21.15.42:0/2214845 <== osd.4 v2:172.21.15.62:6800/37389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe3c1509c0 con 0x7fbe1806d430 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7fbe1806d430 msgr2=0x7fbe1806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7fbe1806d430 0x7fbe1806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe18065220 msgr2=0x7fbe180676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbe18065220 0x7fbe180676d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c033000 tx=0x7fbe2c036000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe3c14fe00 msgr2=0x7fbe3c140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 --2- 172.21.15.42:0/2214845 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe3c14fe00 0x7fbe3c140690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400b4f0 tx=0x7fbe240090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe3b400640 1 -- 172.21.15.42:0/2214845 reap_dead start 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 shutdown_connections 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.597+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 >> 172.21.15.42:0/2214845 conn(0x7fbe3c068680 msgr2=0x7fbe3c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.598+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 shutdown_connections 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.598+0000 7fbe41e00640 1 -- 172.21.15.42:0/2214845 wait complete. 2024-08-17T02:27:31.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.606+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 --> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd058002ca0 con 0x7fd05c075c40 2024-08-17T02:27:31.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.606+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 --> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3e8088b20 con 0x7fe3c806d430 2024-08-17T02:27:31.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.607+0000 7fd06fe00640 1 -- 172.21.15.42:0/3961114952 <== osd.3 v2:172.21.15.42:6816/36876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd058002ca0 con 0x7fd05c075c40 2024-08-17T02:27:31.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.608+0000 7fe3dbe00640 1 -- 172.21.15.42:0/515832532 <== osd.0 v2:172.21.15.42:6800/36872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3e8088b20 con 0x7fe3c806d430 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.608+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7fd05c075c40 msgr2=0x7fd05c078050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.608+0000 7fd081e00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7fd05c075c40 0x7fd05c078050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.608+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd05c06da30 msgr2=0x7fd05c06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.608+0000 7fd081e00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd05c06da30 0x7fd05c06fee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd070009130 tx=0x7fd070032000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7fe3c806d430 msgr2=0x7fe3c806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fe3ee600640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7fe3c806d430 0x7fe3c806f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0740e22b0 msgr2=0x7fd07404ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fd081e00640 1 --2- 172.21.15.42:0/3961114952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0740e22b0 0x7fd07404ea50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd07c000b60 tx=0x7fd07c064990 comp rx=0 tx=0).stop 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fd083400640 1 -- 172.21.15.42:0/3961114952 reap_dead start 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 shutdown_connections 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.609+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 >> 172.21.15.42:0/3961114952 conn(0x7fd074051bf0 msgr2=0x7fd074005cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.610+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 shutdown_connections 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.610+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3c8065220 msgr2=0x7fe3c80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.610+0000 7fd081e00640 1 -- 172.21.15.42:0/3961114952 wait complete. 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.610+0000 7fe3ee600640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3c8065220 0x7fe3c80676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4007fd0 tx=0x7fe3d4007d10 comp rx=0 tx=0).stop 2024-08-17T02:27:31.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.610+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e81588d0 msgr2=0x7fe3e81516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 --> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47e80c4f70 con 0x7f47c406d460 2024-08-17T02:27:31.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.610+0000 7fe3ee600640 1 --2- 172.21.15.42:0/515832532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e81588d0 0x7fe3e81516b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00e990 tx=0x7fe3dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7f47dfe00640 1 -- 172.21.15.42:0/1429231280 <== osd.5 v2:172.21.15.62:6808/37390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47e80c4f70 con 0x7f47c406d460 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7fe3edc00640 1 -- 172.21.15.42:0/515832532 reap_dead start 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 shutdown_connections 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 >> 172.21.15.42:0/515832532 conn(0x7fe3e8087a80 msgr2=0x7fe3e80cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 shutdown_connections 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.611+0000 7fe3ee600640 1 -- 172.21.15.42:0/515832532 wait complete. 2024-08-17T02:27:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.612+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7f47c406d460 msgr2=0x7f47c406f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.612+0000 7f47ee200640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7f47c406d460 0x7f47c406f870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 --> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9800150240 con 0x7f97e006d3c0 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f47c4065250 msgr2=0x7f47c4067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ee200640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f47c4065250 0x7f47c4067700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47d0007fd0 tx=0x7f47d0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e80c87f0 msgr2=0x7f47e80b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ee200640 1 --2- 172.21.15.42:0/1429231280 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e80c87f0 0x7f47e80b2f80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f47e000c510 tx=0x7f47e0007ed0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ed800640 1 -- 172.21.15.42:0/1429231280 reap_dead start 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 shutdown_connections 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.613+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 >> 172.21.15.42:0/1429231280 conn(0x7f47e806b7c0 msgr2=0x7f47e80c3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.614+0000 7f97f3e00640 1 -- 172.21.15.42:0/2716937332 <== osd.1 v2:172.21.15.42:6824/36874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9800150240 con 0x7f97e006d3c0 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.614+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 shutdown_connections 2024-08-17T02:27:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.614+0000 7f47ee200640 1 -- 172.21.15.42:0/1429231280 wait complete. 2024-08-17T02:27:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7f97e006d3c0 msgr2=0x7f97e006f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9806400640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7f97e006d3c0 0x7f97e006f7d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f97e0065230 msgr2=0x7f97e00676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9806400640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f97e0065230 0x7f97e00676e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f980016a490 tx=0x7f97ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 msgr2=0x7f980014fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9806400640 1 --2- 172.21.15.42:0/2716937332 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98000ab3a0 0x7f980014fd00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009850 tx=0x7f97f4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.615+0000 7f9805a00640 1 -- 172.21.15.42:0/2716937332 reap_dead start 2024-08-17T02:27:31.644 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:31.645 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.616+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 shutdown_connections 2024-08-17T02:27:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.616+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 >> 172.21.15.42:0/2716937332 conn(0x7f98000cb780 msgr2=0x7f98000ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.616+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 shutdown_connections 2024-08-17T02:27:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.616+0000 7f9806400640 1 -- 172.21.15.42:0/2716937332 wait complete. 2024-08-17T02:27:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.618+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 --> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f986006e4c0 con 0x7f983c06d430 2024-08-17T02:27:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.619+0000 7f9856a00640 1 -- 172.21.15.42:0/2693596871 <== osd.7 v2:172.21.15.62:6816/37391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f986006e4c0 con 0x7f983c06d430 2024-08-17T02:27:31.646 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:31.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.620+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f983c06d430 msgr2=0x7f983c06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.620+0000 7f9866400640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f983c06d430 0x7f983c06f840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f983c0652a0 msgr2=0x7f983c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f983c0652a0 0x7f983c067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f986015bd40 tx=0x7f9848017040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 msgr2=0x7f986014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 --2- 172.21.15.42:0/2693596871 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f98600ae860 0x7f986014aa70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9850035040 tx=0x7f9850032000 comp rx=0 tx=0).stop 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f985fe00640 1 -- 172.21.15.42:0/2693596871 reap_dead start 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 shutdown_connections 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 >> 172.21.15.42:0/2693596871 conn(0x7f9860066e60 msgr2=0x7f9860152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 shutdown_connections 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.621+0000 7f9866400640 1 -- 172.21.15.42:0/2693596871 wait complete. 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.623+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 --> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb0806e740 con 0x7fbae806d4b0 2024-08-17T02:27:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.623+0000 7fbafe000640 1 -- 172.21.15.42:0/3790675573 <== osd.6 v2:172.21.15.62:6824/37406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbb0806e740 con 0x7fbae806d4b0 2024-08-17T02:27:31.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.624+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fbae806d4b0 msgr2=0x7fbae806f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.624+0000 7fbb07e00640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fbae806d4b0 0x7fbae806f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbae80652a0 msgr2=0x7fbae8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fbae80652a0 0x7fbae8067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8003000 tx=0x7fbaf8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb080a7ba0 msgr2=0x7fbb080a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 --2- 172.21.15.42:0/3790675573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb080a7ba0 0x7fbb080a7ff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e930 tx=0x7fbaf4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07400640 1 -- 172.21.15.42:0/3790675573 reap_dead start 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 shutdown_connections 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 >> 172.21.15.42:0/3790675573 conn(0x7fbb08066e60 msgr2=0x7fbb08156420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 shutdown_connections 2024-08-17T02:27:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.625+0000 7fbb07e00640 1 -- 172.21.15.42:0/3790675573 wait complete. 2024-08-17T02:27:31.652 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:31.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:31.653 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:31.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:31.653 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:31.654 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:31.654 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:31.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:31.655 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:31.656 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:31.656 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:31.657 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:31.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.953+0000 7fd9b6800640 1 Processor -- start 2024-08-17T02:27:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.953+0000 7fd9b6800640 1 -- start start 2024-08-17T02:27:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.955+0000 7fd9b6800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b00b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.955+0000 7fd9b6800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9b006d7d0 0x7fd9b006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.955+0000 7fd9b6800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00aff30 con 0x7fd9b015cdc0 2024-08-17T02:27:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.955+0000 7fd9b6800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b006e150 con 0x7fd9b006d7d0 2024-08-17T02:27:31.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.955+0000 7fd9b6800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00af320 con 0x7fd9b00b03c0 2024-08-17T02:27:31.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.957+0000 7fd9afe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9b006d7d0 0x7fd9b006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.957+0000 7fd9aea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b00b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.958+0000 7fd9af400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd9b015cdc0 0x7fd9b00ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56566/0 (socket says 172.21.15.42:56566) 2024-08-17T02:27:31.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.958+0000 7fd9af400640 1 -- 172.21.15.42:0/1056858460 learned_addr learned my addr 172.21.15.42:0/1056858460 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.959+0000 7fd9aea00640 1 -- 172.21.15.42:0/1056858460 >> v2:172.21.15.42:3300/0 conn(0x7fd9b006d7d0 msgr2=0x7fd9b006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.958+0000 7f2302400640 1 Processor -- start 2024-08-17T02:27:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.958+0000 7f2302400640 1 -- start start 2024-08-17T02:27:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.959+0000 7fd9aea00640 1 --2- 172.21.15.42:0/1056858460 >> v2:172.21.15.42:3300/0 conn(0x7fd9b006d7d0 0x7fd9b006dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.959+0000 7fd9aea00640 1 -- 172.21.15.42:0/1056858460 >> v1:172.21.15.42:6789/0 conn(0x7fd9b015cdc0 legacy=0x7fd9b00ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.959+0000 7fd9aea00640 1 -- 172.21.15.42:0/1056858460 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00af600 con 0x7fd9b00b03c0 2024-08-17T02:27:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f2302400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0ae080 0x7f22fc168f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f2302400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22fc0b04b0 0x7f22fc0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f2302400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc169440 con 0x7f22fc0c82c0 2024-08-17T02:27:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f2302400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0af410 con 0x7f22fc0b04b0 2024-08-17T02:27:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f2302400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0af6f0 con 0x7f22fc0ae080 2024-08-17T02:27:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7fd9afe00640 1 --2- 172.21.15.42:0/1056858460 >> v2:172.21.15.42:3300/0 conn(0x7fd9b006d7d0 0x7fd9b006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f22fb400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0ae080 0x7f22fc168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.961+0000 7f22fbe00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f22fc0c82c0 0x7f22fc06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:44688/0 (socket says 172.21.15.42:44688) 2024-08-17T02:27:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.962+0000 7f22fbe00640 1 -- 172.21.15.42:0/4212953417 learned_addr learned my addr 172.21.15.42:0/4212953417 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.962+0000 7f22f2a00640 1 --2- 172.21.15.42:0/4212953417 >> v2:172.21.15.42:3300/0 conn(0x7f22fc0b04b0 0x7f22fc0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.962+0000 7fd9aea00640 1 --2- 172.21.15.42:0/1056858460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b00b0810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd998009850 tx=0x7fd9980090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69138782ddfee8e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7f22faa00640 1 -- 172.21.15.42:0/4212953417 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165782625 0 0) 0x7f22fc169440 con 0x7f22fc0c82c0 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7fd9ae000640 1 -- 172.21.15.42:0/1056858460 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99802ad20 con 0x7fd9b00b03c0 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7fd9ae000640 1 -- 172.21.15.42:0/1056858460 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99802ae80 con 0x7fd9b00b03c0 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7fd9ae000640 1 -- 172.21.15.42:0/1056858460 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd998032670 con 0x7fd9b00b03c0 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7f22faa00640 1 -- 172.21.15.42:0/4212953417 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e00034e0 con 0x7f22fc0c82c0 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7f22f2a00640 1 -- 172.21.15.42:0/4212953417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0ae080 msgr2=0x7f22fc168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7f22f2a00640 1 --2- 172.21.15.42:0/4212953417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0ae080 0x7f22fc168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7f22f2a00640 1 -- 172.21.15.42:0/4212953417 >> v1:172.21.15.62:6789/0 conn(0x7f22fc0c82c0 legacy=0x7f22fc06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.963+0000 7f22f2a00640 1 -- 172.21.15.42:0/4212953417 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0af9d0 con 0x7f22fc0b04b0 2024-08-17T02:27:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.964+0000 7fd9b6800640 1 -- 172.21.15.42:0/1056858460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 msgr2=0x7fd9b00b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.964+0000 7fd9b6800640 1 --2- 172.21.15.42:0/1056858460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b00b0810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd998009850 tx=0x7fd9980090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.964+0000 7fd9b6800640 1 -- 172.21.15.42:0/1056858460 shutdown_connections 2024-08-17T02:27:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.964+0000 7fd9b6800640 1 --2- 172.21.15.42:0/1056858460 >> v2:172.21.15.42:3300/0 conn(0x7fd9b006d7d0 0x7fd9b006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.964+0000 7fd9b6800640 1 --2- 172.21.15.42:0/1056858460 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b00b0810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.964+0000 7fd9b6800640 1 -- 172.21.15.42:0/1056858460 >> 172.21.15.42:0/1056858460 conn(0x7fd9b0066e60 msgr2=0x7fd9b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.965+0000 7fd9b6800640 1 -- 172.21.15.42:0/1056858460 shutdown_connections 2024-08-17T02:27:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.966+0000 7f22f2a00640 1 --2- 172.21.15.42:0/4212953417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0b0900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009850 tx=0x7f22ec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0515b98797fda1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.966+0000 7f22faa00640 1 -- 172.21.15.42:0/4212953417 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec02ae20 con 0x7f22fc0b04b0 2024-08-17T02:27:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.965+0000 7fd9b6800640 1 -- 172.21.15.42:0/1056858460 wait complete. 2024-08-17T02:27:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.967+0000 7fd9b6800640 1 Processor -- start 2024-08-17T02:27:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.967+0000 7fd9b6800640 1 -- start start 2024-08-17T02:27:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.967+0000 7f22faa00640 1 -- 172.21.15.42:0/4212953417 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec032440 con 0x7f22fc0b04b0 2024-08-17T02:27:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.966+0000 7fe3c5400640 1 Processor -- start 2024-08-17T02:27:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.966+0000 7fe3c5400640 1 -- start start 2024-08-17T02:27:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.967+0000 7f22faa00640 1 -- 172.21.15.42:0/4212953417 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec02ae20 con 0x7f22fc0b04b0 2024-08-17T02:27:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f1d83200640 1 Processor -- start 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f2302400640 1 -- 172.21.15.42:0/4212953417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 msgr2=0x7f22fc0b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f2302400640 1 --2- 172.21.15.42:0/4212953417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0b0900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009850 tx=0x7f22ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f2302400640 1 -- 172.21.15.42:0/4212953417 shutdown_connections 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f2302400640 1 --2- 172.21.15.42:0/4212953417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0b0900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f2302400640 1 --2- 172.21.15.42:0/4212953417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0ae080 0x7f22fc168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f2302400640 1 -- 172.21.15.42:0/4212953417 >> 172.21.15.42:0/4212953417 conn(0x7f22fc066e60 msgr2=0x7f22fc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7fe3c5400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3c01589e0 0x7fe3c0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7f2302400640 1 -- 172.21.15.42:0/4212953417 shutdown_connections 2024-08-17T02:27:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7f2302400640 1 -- 172.21.15.42:0/4212953417 wait complete. 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7fe3c5400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c00cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3c5400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c00af9a0 con 0x7fe3c00ca9c0 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3c5400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c00af810 con 0x7fe3c01589e0 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3c5400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c00cb340 con 0x7fe3c00ce140 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3be800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3c01589e0 0x7fe3c0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3bde00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe3c00ca9c0 0x7fe3c00cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56582/0 (socket says 172.21.15.42:56582) 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3bde00640 1 -- 172.21.15.42:0/965189772 learned_addr learned my addr 172.21.15.42:0/965189772 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fe3bf200640 1 --2- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c00cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fe3be800640 1 -- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 msgr2=0x7fe3c00cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fe3be800640 1 --2- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c00cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fe3be800640 1 -- 172.21.15.42:0/965189772 >> v1:172.21.15.42:6789/0 conn(0x7fe3c00ca9c0 legacy=0x7fe3c00cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fe3be800640 1 -- 172.21.15.42:0/965189772 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00ce740 con 0x7fe3c01589e0 2024-08-17T02:27:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.968+0000 7f1d83200640 1 -- start start 2024-08-17T02:27:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f00e7e00640 1 Processor -- start 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f1d83200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d7c0ea1f0 0x7f1d7c0ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f1d83200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d7c053ff0 0x7f1d7c0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f1d83200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c0e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f1d83200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c055120 con 0x7f1d7c053ff0 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f1d83200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c006320 con 0x7f1d7c0ea1f0 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7f1d83200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c006600 con 0x7f1d7c054470 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fd9b6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b006d7d0 0x7fd9b01421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fd9b6800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.969+0000 7fd9b6800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 0x7fd9b014de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fd9b6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0145f80 con 0x7fd9b006d7d0 2024-08-17T02:27:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7f1d81e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d7c0ea1f0 0x7f1d7c0ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7f1d81e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d7c0ea1f0 0x7f1d7c0ea5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41082/0 (socket says 172.21.15.42:41082) 2024-08-17T02:27:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7f1d81e00640 1 -- 172.21.15.42:0/3029943757 learned_addr learned my addr 172.21.15.42:0/3029943757 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fd9b6800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0167a70 con 0x7fd9b015cdc0 2024-08-17T02:27:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.970+0000 7fd9b6800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0145320 con 0x7fd9b00b03c0 2024-08-17T02:27:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7f00e7e00640 1 -- start start 2024-08-17T02:27:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7f2302400640 1 Processor -- start 2024-08-17T02:27:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7fd9afe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 0x7fd9b014de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7fd9afe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 0x7fd9b014de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41088/0 (socket says 172.21.15.42:41088) 2024-08-17T02:27:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.971+0000 7fd9afe00640 1 -- 172.21.15.42:0/869344399 learned_addr learned my addr 172.21.15.42:0/869344399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fd9aea00640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7f2302400640 1 -- start start 2024-08-17T02:27:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fe3be800640 1 --2- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01589e0 0x7fe3c0158db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009850 tx=0x7fe3b00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20e8abc693553d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fc771a00640 1 Processor -- start 2024-08-17T02:27:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7f1d81e00640 1 -- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 msgr2=0x7f1d7c0e93c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:27:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7f1d81e00640 1 --2- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c0e93c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7f1d81e00640 1 -- 172.21.15.42:0/3029943757 >> v2:172.21.15.42:3300/0 conn(0x7f1d7c053ff0 msgr2=0x7f1d7c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7f1d81e00640 1 --2- 172.21.15.42:0/3029943757 >> v2:172.21.15.42:3300/0 conn(0x7f1d7c053ff0 0x7f1d7c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7f1d81e00640 1 -- 172.21.15.42:0/3029943757 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0068e0 con 0x7f1d7c0ea1f0 2024-08-17T02:27:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fd9afe00640 1 -- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 msgr2=0x7fd9b014d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fd9afe00640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b014d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fd9afe00640 1 -- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b006d7d0 msgr2=0x7fd9b01421e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fc771a00640 1 -- start start 2024-08-17T02:27:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.972+0000 7fe3bd400640 1 -- 172.21.15.42:0/965189772 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b002ad00 con 0x7fe3c01589e0 2024-08-17T02:27:31.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7fd9af400640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b006d7d0 0x7fd9b01421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7fd9afe00640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b006d7d0 0x7fd9b01421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7fd9afe00640 1 -- 172.21.15.42:0/869344399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009390 con 0x7fd9b015cdc0 2024-08-17T02:27:31.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7fe3bd400640 1 -- 172.21.15.42:0/965189772 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b002ae60 con 0x7fe3c01589e0 2024-08-17T02:27:31.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7fe3bd400640 1 -- 172.21.15.42:0/965189772 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0032670 con 0x7fe3c01589e0 2024-08-17T02:27:31.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f00e7e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00e81588d0 0x7f00e80ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f00e7e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e80af600 con 0x7f00e80cf1f0 2024-08-17T02:27:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f00e7e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e80cb280 con 0x7f00e81588d0 2024-08-17T02:27:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f00e7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80afb60 con 0x7f00e8158ca0 2024-08-17T02:27:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7fd9af400640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b006d7d0 0x7fd9b01421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:31.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f2302400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22fc0ae080 0x7f22fc15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f2302400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f2302400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0c82c0 0x7f22fc181a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f2302400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc0c2210 con 0x7f22fc0b04b0 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f2302400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15b830 con 0x7f22fc0ae080 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f2302400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15ac20 con 0x7f22fc0c82c0 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.973+0000 7f00e6a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00e81588d0 0x7f00e80ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f00e6a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00e81588d0 0x7f00e80ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41096/0 (socket says 172.21.15.42:41096) 2024-08-17T02:27:31.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f00e6a00640 1 -- 172.21.15.42:0/3707623455 learned_addr learned my addr 172.21.15.42:0/3707623455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7fe3c5400640 1 -- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01589e0 msgr2=0x7fe3c0158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7fe3c5400640 1 --2- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01589e0 0x7fe3c0158db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009850 tx=0x7fe3b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f22fb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22fc0ae080 0x7f22fc15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7fe3c5400640 1 -- 172.21.15.42:0/965189772 shutdown_connections 2024-08-17T02:27:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f22fb400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22fc0ae080 0x7f22fc15a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41112/0 (socket says 172.21.15.42:41112) 2024-08-17T02:27:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7fe3c5400640 1 --2- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c00cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7fe3c5400640 1 --2- 172.21.15.42:0/965189772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c01589e0 0x7fe3c0158db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f22fb400640 1 -- 172.21.15.42:0/3722217594 learned_addr learned my addr 172.21.15.42:0/3722217594 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f22fbe00640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0c82c0 0x7f22fc181a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7fe3c5400640 1 -- 172.21.15.42:0/965189772 >> 172.21.15.42:0/965189772 conn(0x7fe3c006e590 msgr2=0x7fe3c006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.974+0000 7f00e6000640 1 --2- 172.21.15.42:0/3707623455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fe3c5400640 1 -- 172.21.15.42:0/965189772 shutdown_connections 2024-08-17T02:27:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fd9afe00640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 0x7fd9b014de80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000d890 tx=0x7fd9a0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f00e5600640 1 -- 172.21.15.42:0/3707623455 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079350420 0 0) 0x7f00e80af600 con 0x7f00e80cf1f0 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f00e6000640 1 -- 172.21.15.42:0/3707623455 >> v2:172.21.15.62:3300/0 conn(0x7f00e81588d0 msgr2=0x7f00e80ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f00e6000640 1 --2- 172.21.15.42:0/3707623455 >> v2:172.21.15.62:3300/0 conn(0x7f00e81588d0 0x7f00e80ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f00e6000640 1 -- 172.21.15.42:0/3707623455 >> v1:172.21.15.42:6789/0 conn(0x7f00e80cf1f0 legacy=0x7f00e80cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f00e6000640 1 -- 172.21.15.42:0/3707623455 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80d04e0 con 0x7f00e8158ca0 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f22f2a00640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f22fbe00640 1 -- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22fc0ae080 msgr2=0x7f22fc15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc771a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 0x7fc76c0d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc771a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc76c0ce380 0x7fc76c0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc771a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0d05b0 con 0x7fc76c14fe00 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc771a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0af8e0 con 0x7fc76c0ce380 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc771a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0cdef0 con 0x7fc76c0cfc10 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc76a000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 0x7fc76c0d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc76a000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 0x7fc76c0d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35450/0 (socket says 172.21.15.42:35450) 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc76a000640 1 -- 172.21.15.42:0/2321912801 learned_addr learned my addr 172.21.15.42:0/2321912801 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fc76b400640 1 --2- 172.21.15.42:0/2321912801 >> v2:172.21.15.42:3300/0 conn(0x7fc76c0ce380 0x7fc76c0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000b6c0 con 0x7fd9b015cdc0 2024-08-17T02:27:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7f22fbe00640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22fc0ae080 0x7f22fc15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7f22fbe00640 1 -- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 msgr2=0x7f22fc0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7f22fbe00640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7f22fbe00640 1 -- 172.21.15.42:0/3722217594 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009390 con 0x7f22fc0c82c0 2024-08-17T02:27:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7f1d81e00640 1 --2- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c0ea5c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d84064f60 tx=0x7f1d84064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c1615d3eb8f3056 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a000b820 con 0x7fd9b015cdc0 2024-08-17T02:27:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fc769600640 1 -- 172.21.15.42:0/2321912801 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127430033 0 0) 0x7fc764001110 con 0x7fc76c14fe00 2024-08-17T02:27:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b0145600 con 0x7fd9b015cdc0 2024-08-17T02:27:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0145bc0 con 0x7fd9b015cdc0 2024-08-17T02:27:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7f22f2a00640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.975+0000 7fe3c5400640 1 -- 172.21.15.42:0/965189772 wait complete. 2024-08-17T02:27:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f22fbe00640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0c82c0 0x7f22fc181a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f22f4001560 tx=0x7f22f4001a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7f00e6000640 1 --2- 172.21.15.42:0/3707623455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80cad40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009850 tx=0x7f00d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ecdbe068fcd235 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7fe3c5400640 1 Processor -- start 2024-08-17T02:27:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fc769600640 1 -- 172.21.15.42:0/2321912801 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7500034e0 con 0x7fc76c14fe00 2024-08-17T02:27:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fc76a000640 1 -- 172.21.15.42:0/2321912801 >> v2:172.21.15.42:3300/0 conn(0x7fc76c0ce380 msgr2=0x7fc76c0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fc76a000640 1 --2- 172.21.15.42:0/2321912801 >> v2:172.21.15.42:3300/0 conn(0x7fc76c0ce380 0x7fc76c0ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fc76a000640 1 -- 172.21.15.42:0/2321912801 >> v1:172.21.15.42:6789/0 conn(0x7fc76c14fe00 legacy=0x7fc76c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.976+0000 7fc76a000640 1 -- 172.21.15.42:0/2321912801 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0ccf10 con 0x7fc76c0cfc10 2024-08-17T02:27:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000bbe0 con 0x7fd9b015cdc0 2024-08-17T02:27:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f1d80a00640 1 -- 172.21.15.42:0/3029943757 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a93f0 con 0x7f1d7c0ea1f0 2024-08-17T02:27:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f1d80a00640 1 -- 172.21.15.42:0/3029943757 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d840a9590 con 0x7f1d7c0ea1f0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f1d80a00640 1 -- 172.21.15.42:0/3029943757 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a99d0 con 0x7f1d7c0ea1f0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400a640 con 0x7f22fc0c82c0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400a7a0 con 0x7f22fc0c82c0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.977+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400ab40 con 0x7f22fc0c82c0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc15af00 con 0x7f22fc0c82c0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc15b4c0 con 0x7f22fc0c82c0 2024-08-17T02:27:31.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7fe3c5400640 1 -- start start 2024-08-17T02:27:31.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f00e5600640 1 -- 172.21.15.42:0/3707623455 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d402ad20 con 0x7f00e8158ca0 2024-08-17T02:27:31.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 -- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c0ea1f0 msgr2=0x7f1d7c0ea5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 --2- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c0ea5c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d84064f60 tx=0x7f1d84064990 comp rx=0 tx=0).stop 2024-08-17T02:27:31.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 -- 172.21.15.42:0/3029943757 shutdown_connections 2024-08-17T02:27:31.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 --2- 172.21.15.42:0/3029943757 >> v2:172.21.15.42:3300/0 conn(0x7f1d7c053ff0 0x7f1d7c0073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 --2- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c0e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 --2- 172.21.15.42:0/3029943757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c0ea5c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7f00e5600640 1 -- 172.21.15.42:0/3707623455 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d402ae80 con 0x7f00e8158ca0 2024-08-17T02:27:31.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.978+0000 7f1d83200640 1 -- 172.21.15.42:0/3029943757 >> 172.21.15.42:0/3029943757 conn(0x7f1d7c055a10 msgr2=0x7f1d7c055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7f00e5600640 1 -- 172.21.15.42:0/3707623455 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d402ad20 con 0x7f00e8158ca0 2024-08-17T02:27:31.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7f1d83200640 1 -- 172.21.15.42:0/3029943757 shutdown_connections 2024-08-17T02:27:31.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fe3c5400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c00ca9c0 0x7fe3c01661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7f1d83200640 1 -- 172.21.15.42:0/3029943757 wait complete. 2024-08-17T02:27:31.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd988005210 con 0x7fd9b015cdc0 2024-08-17T02:27:31.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fe3c5400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fe3c5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 0x7fe3c014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fe3c5400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c014dda0 con 0x7fe3c01589e0 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fe3c5400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0150340 con 0x7fe3c00ca9c0 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.979+0000 7fe3c5400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c01653e0 con 0x7fe3c00ce140 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3be800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c00ca9c0 0x7fe3c01661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 0x7fe3c014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bde00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 0x7fe3c014fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43798/0 (socket says 172.21.15.42:43798) 2024-08-17T02:27:32.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 -- 172.21.15.42:0/1827428615 learned_addr learned my addr 172.21.15.42:0/1827428615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7f00e7e00640 1 -- 172.21.15.42:0/3707623455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 msgr2=0x7f00e80cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7f00e7e00640 1 --2- 172.21.15.42:0/3707623455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80cad40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009850 tx=0x7f00d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7f00e7e00640 1 -- 172.21.15.42:0/3707623455 shutdown_connections 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7f00e7e00640 1 --2- 172.21.15.42:0/3707623455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80cad40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7f00e7e00640 1 --2- 172.21.15.42:0/3707623455 >> v2:172.21.15.62:3300/0 conn(0x7f00e81588d0 0x7f00e80ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7f00e7e00640 1 -- 172.21.15.42:0/3707623455 >> 172.21.15.42:0/3707623455 conn(0x7f00e8087a80 msgr2=0x7f00e806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 -- 172.21.15.42:0/1827428615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 msgr2=0x7fe3c014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 -- 172.21.15.42:0/1827428615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c00ca9c0 msgr2=0x7fe3c01661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.980+0000 7fe3bf200640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c00ca9c0 0x7fe3c01661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7fe3bf200640 1 -- 172.21.15.42:0/1827428615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0009390 con 0x7fe3c01589e0 2024-08-17T02:27:32.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7fc76a000640 1 --2- 172.21.15.42:0/2321912801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 0x7fc76c0d0070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f20 tx=0x7fc75c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30d3b07670b600e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc063fb0 con 0x7f22fc0c82c0 2024-08-17T02:27:32.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7f00e7e00640 1 -- 172.21.15.42:0/3707623455 shutdown_connections 2024-08-17T02:27:32.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7fc769600640 1 -- 172.21.15.42:0/2321912801 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c031400 con 0x7fc76c0cfc10 2024-08-17T02:27:32.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7fc769600640 1 -- 172.21.15.42:0/2321912801 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c02d050 con 0x7fc76c0cfc10 2024-08-17T02:27:32.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7fc769600640 1 -- 172.21.15.42:0/2321912801 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0317d0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.982+0000 7f1d83200640 1 Processor -- start 2024-08-17T02:27:32.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.981+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f22f40070f0 con 0x7f22fc0c82c0 2024-08-17T02:27:32.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.982+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9a001e460 con 0x7fd9b015cdc0 2024-08-17T02:27:32.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.982+0000 7f1d83200640 1 -- start start 2024-08-17T02:27:32.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.982+0000 7fe3bf200640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 0x7fe3c014fe00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009e90 tx=0x7fe3b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.982+0000 7f00e7e00640 1 -- 172.21.15.42:0/3707623455 wait complete. 2024-08-17T02:27:32.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.982+0000 7f22f3400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f22d80652a0 0x7f22d8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f244ba00640 1 Processor -- start 2024-08-17T02:27:32.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22f4082530 con 0x7f22fc0c82c0 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800ce10 con 0x7fe3c01589e0 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b800f040 con 0x7fe3c01589e0 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b80146d0 con 0x7fe3c01589e0 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7fd9a6a00640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd98c065250 0x7fd98c067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9a0082ac0 con 0x7fd9b015cdc0 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f1d83200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c053ff0 0x7f1d7c03c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f1d83200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c03c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f1d83200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c103410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f1d83200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c03dfd0 con 0x7f1d7c0ea1f0 2024-08-17T02:27:32.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f1d83200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c03eaf0 con 0x7f1d7c053ff0 2024-08-17T02:27:32.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f1d83200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c03e1c0 con 0x7f1d7c054470 2024-08-17T02:27:32.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7fd9af400640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd98c065250 0x7fd98c067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f22fb400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f22d80652a0 0x7f22d8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7fe3c5400640 1 -- 172.21.15.42:0/1827428615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c01656c0 con 0x7fe3c01589e0 2024-08-17T02:27:32.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7fe3c5400640 1 -- 172.21.15.42:0/1827428615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c0165c80 con 0x7fe3c01589e0 2024-08-17T02:27:32.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7fc771a00640 1 -- 172.21.15.42:0/2321912801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 msgr2=0x7fc76c0d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7fc771a00640 1 --2- 172.21.15.42:0/2321912801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 0x7fc76c0d0070 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f20 tx=0x7fc75c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:32.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7f1d81400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c03c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7f1d81400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c03c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35464/0 (socket says 172.21.15.42:35464) 2024-08-17T02:27:32.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7f1d81400640 1 -- 172.21.15.42:0/2496106047 learned_addr learned my addr 172.21.15.42:0/2496106047 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7fa35c200640 1 Processor -- start 2024-08-17T02:27:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7f1d82800640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c103410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.983+0000 7f244ba00640 1 -- start start 2024-08-17T02:27:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f22fb400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f22d80652a0 0x7f22d8067750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0cc0c0 tx=0x7f22e40090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f00e7e00640 1 Processor -- start 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7fc771a00640 1 -- 172.21.15.42:0/2321912801 shutdown_connections 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7fc771a00640 1 --2- 172.21.15.42:0/2321912801 >> v2:172.21.15.42:3300/0 conn(0x7fc76c0ce380 0x7fc76c0ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7fc771a00640 1 --2- 172.21.15.42:0/2321912801 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c0cfc10 0x7fc76c0d0070 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7fc771a00640 1 -- 172.21.15.42:0/2321912801 >> 172.21.15.42:0/2321912801 conn(0x7fc76c068680 msgr2=0x7fc76c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7fc771a00640 1 -- 172.21.15.42:0/2321912801 shutdown_connections 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7fc771a00640 1 -- 172.21.15.42:0/2321912801 wait complete. 2024-08-17T02:27:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d81400640 1 -- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c053ff0 msgr2=0x7f1d7c03c3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d81400640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c053ff0 0x7f1d7c03c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d81400640 1 -- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d7c0ea1f0 msgr2=0x7f1d7c103410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d81400640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c103410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d81400640 1 -- 172.21.15.42:0/2496106047 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8404c200 con 0x7f1d7c054470 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f244ba00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24440b03c0 0x7f24440b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f244ba00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f244406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f244ba00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440aff30 con 0x7f244415cdc0 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f244ba00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244406e150 con 0x7f24440b03c0 2024-08-17T02:27:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f244ba00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440af320 con 0x7f244406d7d0 2024-08-17T02:27:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.984+0000 7fa35c200640 1 -- start start 2024-08-17T02:27:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f00e7e00640 1 -- start start 2024-08-17T02:27:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d82800640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.985+0000 7f1d81400640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c03c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000b5e0 tx=0x7f1d70009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7f2449a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f244406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7f2449a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f244406dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35470/0 (socket says 172.21.15.42:35470) 2024-08-17T02:27:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7f2449a00640 1 -- 172.21.15.42:0/1004109289 learned_addr learned my addr 172.21.15.42:0/1004109289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fe3c5400640 1 -- 172.21.15.42:0/1827428615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c015c820 con 0x7fe3c01589e0 2024-08-17T02:27:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa35c200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540b0e40 0x7fa3540ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa35c200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540af9a0 con 0x7fa3540cb0d0 2024-08-17T02:27:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7f2443e00640 1 --2- 172.21.15.42:0/1004109289 >> v2:172.21.15.62:3300/0 conn(0x7f24440b03c0 0x7f24440b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa359800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa3541589e0 0x7fa3540ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:44704/0 (socket says 172.21.15.42:44704) 2024-08-17T02:27:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa359800640 1 -- 172.21.15.42:0/322723098 learned_addr learned my addr 172.21.15.42:0/322723098 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa35c200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540ce740 con 0x7fa3541589e0 2024-08-17T02:27:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f2449a00640 1 -- 172.21.15.42:0/1004109289 >> v2:172.21.15.62:3300/0 conn(0x7f24440b03c0 msgr2=0x7f24440b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f2449a00640 1 --2- 172.21.15.42:0/1004109289 >> v2:172.21.15.62:3300/0 conn(0x7f24440b03c0 0x7f24440b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f2449a00640 1 -- 172.21.15.42:0/1004109289 >> v1:172.21.15.42:6789/0 conn(0x7f244415cdc0 legacy=0x7f24440ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa35c200640 1 -- 172.21.15.42:0/322723098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540af810 con 0x7fa3540b0e40 2024-08-17T02:27:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.986+0000 7fa35a200640 1 --2- 172.21.15.42:0/322723098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540b0e40 0x7fa3540ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f2449a00640 1 -- 172.21.15.42:0/1004109289 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440af600 con 0x7f244406d7d0 2024-08-17T02:27:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00e80cf1f0 0x7f00e80b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7fa35a200640 1 -- 172.21.15.42:0/322723098 >> v1:172.21.15.62:6789/0 conn(0x7fa3541589e0 legacy=0x7fa3540ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7fa35a200640 1 -- 172.21.15.42:0/322723098 >> v1:172.21.15.42:6789/0 conn(0x7fa3540cb0d0 legacy=0x7fa3540cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7fa35a200640 1 -- 172.21.15.42:0/322723098 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540cea00 con 0x7fa3540b0e40 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e81588d0 0x7f00e8153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e81597e0 con 0x7f00e81588d0 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c85d0 con 0x7f00e80cf1f0 2024-08-17T02:27:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e80c8b30 con 0x7f00e8158ca0 2024-08-17T02:27:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7fd9af400640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd98c065250 0x7fd98c067700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8002250 tx=0x7fd9a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.987+0000 7f00e7400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35482/0 (socket says 172.21.15.42:35482) 2024-08-17T02:27:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 -- 172.21.15.42:0/485059463 learned_addr learned my addr 172.21.15.42:0/485059463 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e6a00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00e80cf1f0 0x7f00e80b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e6000640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e81588d0 0x7f00e8153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 -- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00e80cf1f0 msgr2=0x7f00e80b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00e80cf1f0 0x7f00e80b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 -- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e81588d0 msgr2=0x7f00e8153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e81588d0 0x7f00e8153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 -- 172.21.15.42:0/485059463 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009390 con 0x7f00e8158ca0 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f00e7400640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80c8fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c930 tx=0x7f00e00016c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7f2449a00640 1 --2- 172.21.15.42:0/1004109289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f244406dc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2434009910 tx=0x7f24340091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c431082e4d5f4107 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.988+0000 7fa35a200640 1 --2- 172.21.15.42:0/322723098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540b0e40 0x7fa3540ce140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e90 tx=0x7fa34c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a696efe4e465fd9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.989+0000 7fc771a00640 1 Processor -- start 2024-08-17T02:27:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.989+0000 7fc771a00640 1 -- start start 2024-08-17T02:27:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.989+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3b8014a80 con 0x7fe3c01589e0 2024-08-17T02:27:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fe3b6000640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3a0065220 0x7fe3a00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3b8083590 con 0x7fe3c01589e0 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fe3be800640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3a0065220 0x7fe3a00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fc771a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc76c0ce380 0x7fc76c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fc771a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 0x7fc76c1485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fc771a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c14fe00 0x7fc76c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fc771a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c16c7e0 con 0x7fc76c0ce380 2024-08-17T02:27:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fc771a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c16d640 con 0x7fc76c0cfc10 2024-08-17T02:27:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.990+0000 7fc771a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15d9a0 con 0x7fc76c14fe00 2024-08-17T02:27:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fe3be800640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3a0065220 0x7fe3a00676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0034000 tx=0x7fe3b0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 0x7fc76c1485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 0x7fc76c1485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41152/0 (socket says 172.21.15.42:41152) 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 -- 172.21.15.42:0/1759089364 learned_addr learned my addr 172.21.15.42:0/1759089364 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76aa00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc76c0ce380 0x7fc76c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76b400640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c14fe00 0x7fc76c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 -- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c14fe00 msgr2=0x7fc76c0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c14fe00 0x7fc76c0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 -- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc76c0ce380 msgr2=0x7fc76c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc76c0ce380 0x7fc76c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.991+0000 7fc76a000640 1 -- 172.21.15.42:0/1759089364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c009ae0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.992+0000 7fc76a000640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 0x7fc76c1485e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f80 tx=0x7fc75c036000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.993+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c031860 con 0x7fc76c0cfc10 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c008ad0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c008e90 con 0x7fc76c0cfc10 2024-08-17T02:27:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c16ca30 con 0x7fc76c0cfc10 2024-08-17T02:27:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c16cff0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd9a0050b60 con 0x7fd9b015cdc0 2024-08-17T02:27:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000f590 con 0x7f1d7c054470 2024-08-17T02:27:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f2443400640 1 -- 172.21.15.42:0/1004109289 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243402adb0 con 0x7f244406d7d0 2024-08-17T02:27:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f2443400640 1 -- 172.21.15.42:0/1004109289 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434032440 con 0x7f244406d7d0 2024-08-17T02:27:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f2443400640 1 -- 172.21.15.42:0/1004109289 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434032820 con 0x7f244406d7d0 2024-08-17T02:27:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000f6f0 con 0x7f1d7c054470 2024-08-17T02:27:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000fab0 con 0x7f1d7c054470 2024-08-17T02:27:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c03e4a0 con 0x7f1d7c054470 2024-08-17T02:27:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c04fcf0 con 0x7f1d7c054470 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.994+0000 7fa353e00640 1 -- 172.21.15.42:0/322723098 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c007550 con 0x7fa3540b0e40 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7fa353e00640 1 -- 172.21.15.42:0/322723098 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c02d050 con 0x7fa3540b0e40 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7fa353e00640 1 -- 172.21.15.42:0/322723098 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c007920 con 0x7fa3540b0e40 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000a7f0 con 0x7f00e8158ca0 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000a950 con 0x7f00e8158ca0 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f244ba00640 1 -- 172.21.15.42:0/1004109289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 msgr2=0x7f244406dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f244ba00640 1 --2- 172.21.15.42:0/1004109289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f244406dc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2434009910 tx=0x7f24340091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000acf0 con 0x7f00e8158ca0 2024-08-17T02:27:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22f4050710 con 0x7f22fc0c82c0 2024-08-17T02:27:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f244ba00640 1 -- 172.21.15.42:0/1004109289 shutdown_connections 2024-08-17T02:27:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f244ba00640 1 --2- 172.21.15.42:0/1004109289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f244406dc10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f244ba00640 1 --2- 172.21.15.42:0/1004109289 >> v2:172.21.15.62:3300/0 conn(0x7f24440b03c0 0x7f24440b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f244ba00640 1 -- 172.21.15.42:0/1004109289 >> 172.21.15.42:0/1004109289 conn(0x7f2444066e60 msgr2=0x7f2444067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e81540e0 con 0x7f00e8158ca0 2024-08-17T02:27:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e8159500 con 0x7f00e8158ca0 2024-08-17T02:27:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c0056a0 con 0x7f1d7c054470 2024-08-17T02:27:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7f244ba00640 1 -- 172.21.15.42:0/1004109289 shutdown_connections 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 -- 172.21.15.42:0/322723098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540b0e40 msgr2=0x7fa3540ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 --2- 172.21.15.42:0/322723098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540b0e40 0x7fa3540ce140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e90 tx=0x7fa34c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 -- 172.21.15.42:0/322723098 shutdown_connections 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 --2- 172.21.15.42:0/322723098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540b0e40 0x7fa3540ce140 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 -- 172.21.15.42:0/322723098 >> 172.21.15.42:0/322723098 conn(0x7fa35406e590 msgr2=0x7fa35406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 -- 172.21.15.42:0/322723098 shutdown_connections 2024-08-17T02:27:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7fa35c200640 1 -- 172.21.15.42:0/322723098 wait complete. 2024-08-17T02:27:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.996+0000 7f244ba00640 1 -- 172.21.15.42:0/1004109289 wait complete. 2024-08-17T02:27:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.995+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c063fb0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.997+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe3b80551f0 con 0x7fe3c01589e0 2024-08-17T02:27:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.997+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e80cec10 con 0x7f00e8158ca0 2024-08-17T02:27:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.998+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1d7001a460 con 0x7f1d7c054470 2024-08-17T02:27:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.998+0000 7fa35c200640 1 Processor -- start 2024-08-17T02:27:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.998+0000 7fa35c200640 1 -- start start 2024-08-17T02:27:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.998+0000 7f244ba00640 1 Processor -- start 2024-08-17T02:27:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.999+0000 7f1d79600640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d640652a0 0x7f1d64067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.999+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d700820b0 con 0x7f1d7c054470 2024-08-17T02:27:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35c200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3540b0e40 0x7fa35414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35c200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 0x7fa3540b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35c200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 0x7fa35416cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.999+0000 7f244ba00640 1 -- start start 2024-08-17T02:27:32.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:31.999+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc75c038050 con 0x7fc76c0cfc10 2024-08-17T02:27:32.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa358e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 0x7fa3540b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00e0003030 con 0x7f00e8158ca0 2024-08-17T02:27:32.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fc762000640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc748065220 0x7fc7480676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc75c0a2df0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7f1d81e00640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d640652a0 0x7f1d64067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7f244ba00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f2444144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7f244ba00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 0x7f24441564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7f244ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f244415cdc0 0x7f2444156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7f2449000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f2444144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7f2449000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f2444144eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35500/0 (socket says 172.21.15.42:35500) 2024-08-17T02:27:32.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa358e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 0x7fa3540b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35496/0 (socket says 172.21.15.42:35496) 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35c200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540b5890 con 0x7fa3540b0e40 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35c200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540b35f0 con 0x7fa3541589e0 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35c200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35414e3b0 con 0x7fa3540cb0d0 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.000+0000 7fa35a200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 0x7fa35416cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 0x7fa35416cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41168/0 (socket says 172.21.15.42:41168) 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 -- 172.21.15.42:0/2802514018 learned_addr learned my addr 172.21.15.42:0/2802514018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa359800640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3540b0e40 0x7fa35414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 -- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 msgr2=0x7fa3540b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f2443e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 0x7f24441564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 0x7fa3540b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 -- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3540b0e40 msgr2=0x7fa35414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3540b0e40 0x7fa35414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 -- 172.21.15.42:0/2802514018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c009a20 con 0x7fa3541589e0 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa358e00640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 0x7fa3540b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.001+0000 7fa35a200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 0x7fa35416cd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009de0 tx=0x7fa34c037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f2443e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 0x7f24441564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41172/0 (socket says 172.21.15.42:41172) 2024-08-17T02:27:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f00de000640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f00c8065220 0x7f00c80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441520a0 con 0x7f244415cdc0 2024-08-17T02:27:32.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444152380 con 0x7f24440b03c0 2024-08-17T02:27:32.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2444152660 con 0x7f244406d7d0 2024-08-17T02:27:32.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f2449000640 1 -- 172.21.15.42:0/1121442149 learned_addr learned my addr 172.21.15.42:0/1121442149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:32.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00e00829c0 con 0x7f00e8158ca0 2024-08-17T02:27:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7fc76aa00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc748065220 0x7fc7480676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.002+0000 7f00e6a00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f00c8065220 0x7f00c80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f1d81e00640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d640652a0 0x7f1d64067750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c006460 tx=0x7f1d840ab000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f2449000640 1 -- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 msgr2=0x7f24441564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f2449000640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 0x7f24441564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f2449000640 1 -- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f244415cdc0 msgr2=0x7f2444156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f2449000640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f244415cdc0 0x7f2444156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f00e6a00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f00c8065220 0x7f00c80676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009d20 tx=0x7f00d80091d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f2449000640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434009450 con 0x7f244406d7d0 2024-08-17T02:27:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7f2443e00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 0x7f24441564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.003+0000 7fc76aa00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc748065220 0x7fc7480676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc764007fd0 tx=0x7fc764009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.004+0000 7f2449000640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f2444144eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f243c00bbb0 tx=0x7f243c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.005+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f00e0050ba0 con 0x7f00e8158ca0 2024-08-17T02:27:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.009+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c031930 con 0x7fa3541589e0 2024-08-17T02:27:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.010+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c040070 con 0x7fa3541589e0 2024-08-17T02:27:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.010+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c031d00 con 0x7fa3541589e0 2024-08-17T02:27:32.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.010+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc75c070ff0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.010+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35414e690 con 0x7fa3541589e0 2024-08-17T02:27:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.010+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540b3280 con 0x7fa3541589e0 2024-08-17T02:27:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.012+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3540b3780 con 0x7fa3541589e0 2024-08-17T02:27:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.012+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d700501d0 con 0x7f1d7c054470 2024-08-17T02:27:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.012+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0092e0 con 0x7f244406d7d0 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.012+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00c860 con 0x7f244406d7d0 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.012+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00cc40 con 0x7f244406d7d0 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.013+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2444152940 con 0x7f244406d7d0 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.013+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2444151d00 con 0x7f244406d7d0 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.013+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa34c042030 con 0x7fa3541589e0 2024-08-17T02:27:32.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.014+0000 7fa350c00640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3340652d0 0x7fa334067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.015+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa34c0a3da0 con 0x7fa3541589e0 2024-08-17T02:27:32.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.015+0000 7fa359800640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3340652d0 0x7fa334067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.015+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2444063fb0 con 0x7f244406d7d0 2024-08-17T02:27:32.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.016+0000 7fa359800640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3340652d0 0x7fa334067780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3400018c0 tx=0x7fa340009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.017+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f243c012070 con 0x7f244406d7d0 2024-08-17T02:27:32.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.018+0000 7f243be00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2420065220 0x7f24200676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.018+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f243c0820c0 con 0x7f244406d7d0 2024-08-17T02:27:32.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.019+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa34c071e40 con 0x7fa3541589e0 2024-08-17T02:27:32.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.019+0000 7f2443e00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2420065220 0x7f24200676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.020+0000 7f2443e00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2420065220 0x7f24200676d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2444154880 tx=0x7f242c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.022+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f243c050160 con 0x7f244406d7d0 2024-08-17T02:27:32.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.404+0000 7fe3c5400640 1 -- 172.21.15.42:0/1827428615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe3c015c820 con 0x7fe3c01589e0 2024-08-17T02:27:32.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.405+0000 7fe3b6000640 1 -- 172.21.15.42:0/1827428615 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3c015c820 con 0x7fe3c01589e0 2024-08-17T02:27:32.408 INFO:teuthology.orchestra.run.smithi042.stdout:55834574851 2024-08-17T02:27:32.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.408+0000 7fe3ab400640 1 -- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3a0065220 msgr2=0x7fe3a00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.408+0000 7fe3ab400640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3a0065220 0x7fe3a00676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0034000 tx=0x7fe3b0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.408+0000 7fe3ab400640 1 -- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 msgr2=0x7fe3c014fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.408+0000 7fe3ab400640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 0x7fe3c014fe00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8009e90 tx=0x7fe3b800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9880054c0 con 0x7fd9b015cdc0 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fe3ab400640 1 -- 172.21.15.42:0/1827428615 shutdown_connections 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fe3ab400640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe3a0065220 0x7fe3a00676d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fe3ab400640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c01589e0 0x7fe3c014fe00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fe3ab400640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3c00ce140 0x7fe3c014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fe3ab400640 1 --2- 172.21.15.42:0/1827428615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3c00ca9c0 0x7fe3c01661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.409+0000 7fe3ab400640 1 -- 172.21.15.42:0/1827428615 >> 172.21.15.42:0/1827428615 conn(0x7fe3c006e590 msgr2=0x7fe3c0156080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.410+0000 7fe3ab400640 1 -- 172.21.15.42:0/1827428615 shutdown_connections 2024-08-17T02:27:32.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.410+0000 7fe3ab400640 1 -- 172.21.15.42:0/1827428615 wait complete. 2024-08-17T02:27:32.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.410+0000 7fd9a6a00640 1 -- 172.21.15.42:0/869344399 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9a0054180 con 0x7fd9b015cdc0 2024-08-17T02:27:32.411 INFO:teuthology.orchestra.run.smithi042.stdout:55834574851 2024-08-17T02:27:32.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd98c065250 msgr2=0x7fd98c067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd98c065250 0x7fd98c067700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8002250 tx=0x7fd9a8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 msgr2=0x7fd9b014de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 0x7fd9b014de80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000d890 tx=0x7fd9a0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 shutdown_connections 2024-08-17T02:27:32.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd98c065250 0x7fd98c067700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9b015cdc0 0x7fd9b014de80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9b00b03c0 0x7fd9b014d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 --2- 172.21.15.42:0/869344399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b006d7d0 0x7fd9b01421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.414+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 >> 172.21.15.42:0/869344399 conn(0x7fd9b0066e60 msgr2=0x7fd9b0160a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.416+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 shutdown_connections 2024-08-17T02:27:32.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.416+0000 7fd9b6800640 1 -- 172.21.15.42:0/869344399 wait complete. 2024-08-17T02:27:32.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.418+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f22fc06e530 con 0x7f22fc0c82c0 2024-08-17T02:27:32.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.419+0000 7f22f3400640 1 -- 172.21.15.42:0/3722217594 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22f4053d30 con 0x7f22fc0c82c0 2024-08-17T02:27:32.420 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:32.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.423+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f22d80652a0 msgr2=0x7f22d8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.423+0000 7f2302400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f22d80652a0 0x7f22d8067750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0cc0c0 tx=0x7f22e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0c82c0 msgr2=0x7f22fc181a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0c82c0 0x7f22fc181a50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f22f4001560 tx=0x7f22f4001a00 comp rx=0 tx=0).stop 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 shutdown_connections 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f22d80652a0 0x7f22d8067750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f22fc0c82c0 0x7f22fc181a50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22fc0b04b0 0x7f22fc0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 --2- 172.21.15.42:0/3722217594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22fc0ae080 0x7f22fc15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 >> 172.21.15.42:0/3722217594 conn(0x7f22fc066e60 msgr2=0x7f22fc0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.424+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 shutdown_connections 2024-08-17T02:27:32.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.425+0000 7f2302400640 1 -- 172.21.15.42:0/3722217594 wait complete. 2024-08-17T02:27:32.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.426+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f00e80cec10 con 0x7f00e8158ca0 2024-08-17T02:27:32.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.427+0000 7f00de000640 1 -- 172.21.15.42:0/485059463 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00e80cec10 con 0x7f00e8158ca0 2024-08-17T02:27:32.431 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:32.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.431+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f00c8065220 msgr2=0x7f00c80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.431+0000 7f00e7e00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f00c8065220 0x7f00c80676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009d20 tx=0x7f00d80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.431+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 msgr2=0x7f00e80c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.431+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d7c00e120 con 0x7f1d7c054470 2024-08-17T02:27:32.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f1d79600640 1 -- 172.21.15.42:0/2496106047 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d700537f0 con 0x7f1d7c054470 2024-08-17T02:27:32.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.431+0000 7f00e7e00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80c8fc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c930 tx=0x7f00e00016c0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 shutdown_connections 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f00c8065220 0x7f00c80676d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00e8158ca0 0x7f00e80c8fc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e81588d0 0x7f00e8153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 --2- 172.21.15.42:0/485059463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00e80cf1f0 0x7f00e80b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 >> 172.21.15.42:0/485059463 conn(0x7f00e8087a80 msgr2=0x7f00e80c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 shutdown_connections 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.432+0000 7f00e7e00640 1 -- 172.21.15.42:0/485059463 wait complete. 2024-08-17T02:27:32.434 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:32.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.434+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc76c0afaf0 con 0x7fc76c0cfc10 2024-08-17T02:27:32.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.437+0000 7fc762000640 1 -- 172.21.15.42:0/1759089364 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc75c049020 con 0x7fc76c0cfc10 2024-08-17T02:27:32.438 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:32.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d640652a0 msgr2=0x7f1d64067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d640652a0 0x7f1d64067750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c006460 tx=0x7f1d840ab000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 msgr2=0x7f1d7c03c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c03c8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000b5e0 tx=0x7f1d70009120 comp rx=0 tx=0).stop 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 shutdown_connections 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d640652a0 0x7f1d64067750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d7c0ea1f0 0x7f1d7c103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d7c054470 0x7f1d7c03c8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 --2- 172.21.15.42:0/2496106047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d7c053ff0 0x7f1d7c03c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.438+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 >> 172.21.15.42:0/2496106047 conn(0x7f1d7c055a10 msgr2=0x7f1d7c03aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.439+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 shutdown_connections 2024-08-17T02:27:32.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.439+0000 7f1d83200640 1 -- 172.21.15.42:0/2496106047 wait complete. 2024-08-17T02:27:32.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-08-17T02:27:32.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.441+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc748065220 msgr2=0x7fc7480676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.441+0000 7fc771a00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc748065220 0x7fc7480676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc764007fd0 tx=0x7fc764009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.442+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 msgr2=0x7fc76c1485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.442+0000 7fc771a00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 0x7fc76c1485e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009f80 tx=0x7fc75c036000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 shutdown_connections 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc748065220 0x7fc7480676d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc76c14fe00 0x7fc76c0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc76c0cfc10 0x7fc76c1485e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 --2- 172.21.15.42:0/1759089364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc76c0ce380 0x7fc76c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 >> 172.21.15.42:0/1759089364 conn(0x7fc76c068680 msgr2=0x7fc76c0b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 shutdown_connections 2024-08-17T02:27:32.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7fc771a00640 1 -- 172.21.15.42:0/1759089364 wait complete. 2024-08-17T02:27:32.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.443+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f24441527a0 con 0x7f244406d7d0 2024-08-17T02:27:32.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-08-17T02:27:32.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.445+0000 7f243be00640 1 -- 172.21.15.42:0/1121442149 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24441527a0 con 0x7f244406d7d0 2024-08-17T02:27:32.445 INFO:teuthology.orchestra.run.smithi042.stdout:55834574851 2024-08-17T02:27:32.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.447+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa354063fb0 con 0x7fa3541589e0 2024-08-17T02:27:32.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.448+0000 7fa350c00640 1 -- 172.21.15.42:0/2802514018 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa34c031e60 con 0x7fa3541589e0 2024-08-17T02:27:32.449 INFO:teuthology.orchestra.run.smithi042.stdout:55834574851 2024-08-17T02:27:32.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.449+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2420065220 msgr2=0x7f24200676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.449+0000 7f244ba00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2420065220 0x7f24200676d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2444154880 tx=0x7f242c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.449+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 msgr2=0x7f2444144eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.449+0000 7f244ba00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f2444144eb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f243c00bbb0 tx=0x7f243c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:32.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 shutdown_connections 2024-08-17T02:27:32.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2420065220 0x7f24200676d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f244415cdc0 0x7f2444156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24440b03c0 0x7f24441564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 --2- 172.21.15.42:0/1121442149 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f244406d7d0 0x7f2444144eb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 >> 172.21.15.42:0/1121442149 conn(0x7f2444066e60 msgr2=0x7f244415f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 shutdown_connections 2024-08-17T02:27:32.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-17T02:27:32.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.450+0000 7f244ba00640 1 -- 172.21.15.42:0/1121442149 wait complete. 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.451+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3340652d0 msgr2=0x7fa334067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.451+0000 7fa35c200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3340652d0 0x7fa334067780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3400018c0 tx=0x7fa340009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.451+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 msgr2=0x7fa35416cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.451+0000 7fa35c200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 0x7fa35416cd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009de0 tx=0x7fa34c037000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 shutdown_connections 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3340652d0 0x7fa334067780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3541589e0 0x7fa35416cd80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3540cb0d0 0x7fa3540b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 --2- 172.21.15.42:0/2802514018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3540b0e40 0x7fa35414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 >> 172.21.15.42:0/2802514018 conn(0x7fa35406e590 msgr2=0x7fa3541551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 shutdown_connections 2024-08-17T02:27:32.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:32.452+0000 7fa35c200640 1 -- 172.21.15.42:0/2802514018 wait complete. 2024-08-17T02:27:32.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-08-17T02:27:32.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-08-17T02:27:32.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-08-17T02:27:32.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-08-17T02:27:32.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-08-17T02:27:33.442 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:33.445 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:33.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:33.464 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:33.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:33.469 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:33.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:33.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.687+0000 7f6db9c00640 1 Processor -- start 2024-08-17T02:27:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.688+0000 7f6db9c00640 1 -- start start 2024-08-17T02:27:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.690+0000 7f6db9c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6dac0e22c0 0x7f6dac0e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.690+0000 7f6db9c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dac054340 0x7f6dac0e6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.690+0000 7f6db9c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac058860 con 0x7f6dac0e1ef0 2024-08-17T02:27:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.690+0000 7f6db9c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac058cf0 con 0x7f6dac0e22c0 2024-08-17T02:27:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.690+0000 7f6db9c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac057c50 con 0x7f6dac054340 2024-08-17T02:27:33.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.691+0000 7f6db3400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6dac0e22c0 0x7f6dac0e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.691+0000 7f6db3400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6dac0e22c0 0x7f6dac0e5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43860/0 (socket says 172.21.15.42:43860) 2024-08-17T02:27:33.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.691+0000 7f6db3400640 1 -- 172.21.15.42:0/2669386922 learned_addr learned my addr 172.21.15.42:0/2669386922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.691+0000 7f6db9200640 1 --2- 172.21.15.42:0/2669386922 >> v2:172.21.15.62:3300/0 conn(0x7f6dac054340 0x7f6dac0e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.692+0000 7f6db3400640 1 -- 172.21.15.42:0/2669386922 >> v2:172.21.15.62:3300/0 conn(0x7f6dac054340 msgr2=0x7f6dac0e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.692+0000 7f6db3400640 1 --2- 172.21.15.42:0/2669386922 >> v2:172.21.15.62:3300/0 conn(0x7f6dac054340 0x7f6dac0e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.692+0000 7f6db3400640 1 -- 172.21.15.42:0/2669386922 >> v1:172.21.15.62:6789/0 conn(0x7f6dac0e1ef0 legacy=0x7f6dac057420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.692+0000 7f6db3400640 1 -- 172.21.15.42:0/2669386922 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac057f30 con 0x7f6dac0e22c0 2024-08-17T02:27:33.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.692+0000 7ff53a800640 1 Processor -- start 2024-08-17T02:27:33.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.693+0000 7ff53a800640 1 -- start start 2024-08-17T02:27:33.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.694+0000 7f6db3400640 1 --2- 172.21.15.42:0/2669386922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0e22c0 0x7f6dac0e5c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0e6c20 tx=0x7f6da80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5884377b426630 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.694+0000 7f6db2a00640 1 -- 172.21.15.42:0/2669386922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da802ad00 con 0x7f6dac0e22c0 2024-08-17T02:27:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.695+0000 7f6db2a00640 1 -- 172.21.15.42:0/2669386922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da802ae60 con 0x7f6dac0e22c0 2024-08-17T02:27:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff53a800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ac230 0x7ff5340ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.695+0000 7f6db2a00640 1 -- 172.21.15.42:0/2669386922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da802ad00 con 0x7f6dac0e22c0 2024-08-17T02:27:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff53a800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5341548e0 0x7ff534154d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff53a800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5341565d0 con 0x7ff5340ab3a0 2024-08-17T02:27:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff53a800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5341562d0 con 0x7ff5341548e0 2024-08-17T02:27:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff53a800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff534156820 con 0x7ff5340ac230 2024-08-17T02:27:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff539400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ac230 0x7ff5340ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff539400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ac230 0x7ff5340ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35510/0 (socket says 172.21.15.42:35510) 2024-08-17T02:27:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.696+0000 7ff539400640 1 -- 172.21.15.42:0/1989947238 learned_addr learned my addr 172.21.15.42:0/1989947238 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.697+0000 7f6db9c00640 1 -- 172.21.15.42:0/2669386922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0e22c0 msgr2=0x7f6dac0e5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.697+0000 7ff539e00640 1 --2- 172.21.15.42:0/1989947238 >> v2:172.21.15.62:3300/0 conn(0x7ff5341548e0 0x7ff534154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.697+0000 7f6db9c00640 1 --2- 172.21.15.42:0/2669386922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0e22c0 0x7f6dac0e5c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0e6c20 tx=0x7f6da80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.697+0000 7ff533e00640 1 -- 172.21.15.42:0/1989947238 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679770275 0 0) 0x7ff5341565d0 con 0x7ff5340ab3a0 2024-08-17T02:27:33.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.697+0000 7f6db9c00640 1 -- 172.21.15.42:0/2669386922 shutdown_connections 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7f6db9c00640 1 --2- 172.21.15.42:0/2669386922 >> v2:172.21.15.62:3300/0 conn(0x7f6dac054340 0x7f6dac0e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7f6db9c00640 1 --2- 172.21.15.42:0/2669386922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0e22c0 0x7f6dac0e5c20 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0e6c20 tx=0x7f6da80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7f6db9c00640 1 -- 172.21.15.42:0/2669386922 >> 172.21.15.42:0/2669386922 conn(0x7f6dac055a10 msgr2=0x7f6dac055e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.697+0000 7ff533e00640 1 -- 172.21.15.42:0/1989947238 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff51c0034e0 con 0x7ff5340ab3a0 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7ff539e00640 1 -- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ac230 msgr2=0x7ff5340ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7ff539e00640 1 --2- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ac230 0x7ff5340ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7ff539e00640 1 -- 172.21.15.42:0/1989947238 >> v1:172.21.15.62:6789/0 conn(0x7ff5340ab3a0 legacy=0x7ff5340aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7ff539e00640 1 -- 172.21.15.42:0/1989947238 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534156b00 con 0x7ff5341548e0 2024-08-17T02:27:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.698+0000 7f6db9c00640 1 -- 172.21.15.42:0/2669386922 shutdown_connections 2024-08-17T02:27:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.699+0000 7f6db9c00640 1 -- 172.21.15.42:0/2669386922 wait complete. 2024-08-17T02:27:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.700+0000 7ff539e00640 1 --2- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5341548e0 0x7ff534154d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009850 tx=0x7ff52c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a2aa2486193b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.700+0000 7ff533e00640 1 -- 172.21.15.42:0/1989947238 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c031510 con 0x7ff5341548e0 2024-08-17T02:27:33.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.701+0000 7f6db9c00640 1 Processor -- start 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.701+0000 7ff533e00640 1 -- 172.21.15.42:0/1989947238 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c02f050 con 0x7ff5341548e0 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 -- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5341548e0 msgr2=0x7ff534154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 --2- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5341548e0 0x7ff534154d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009850 tx=0x7ff52c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 -- 172.21.15.42:0/1989947238 shutdown_connections 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 --2- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5341548e0 0x7ff534154d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 --2- 172.21.15.42:0/1989947238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ac230 0x7ff5340ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 -- 172.21.15.42:0/1989947238 >> 172.21.15.42:0/1989947238 conn(0x7ff5340cb780 msgr2=0x7ff5340cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7ff53a800640 1 -- 172.21.15.42:0/1989947238 shutdown_connections 2024-08-17T02:27:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.702+0000 7f6db9c00640 1 -- start start 2024-08-17T02:27:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.704+0000 7f6db9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dac054340 0x7f6dac0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.704+0000 7f6db9c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dac0e1ef0 0x7f6dac0dc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.704+0000 7f6db9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 0x7f6dac0e3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.703+0000 7ff53a800640 1 -- 172.21.15.42:0/1989947238 wait complete. 2024-08-17T02:27:33.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.705+0000 7f6db9c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0e4970 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.705+0000 7f6db9c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0dcb10 con 0x7f6dac054340 2024-08-17T02:27:33.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.705+0000 7f6db9c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0e3d60 con 0x7f6dac0e1ef0 2024-08-17T02:27:33.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.705+0000 7ff53a800640 1 Processor -- start 2024-08-17T02:27:33.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.706+0000 7ff53a800640 1 -- start start 2024-08-17T02:27:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.706+0000 7f6db9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 0x7f6dac0e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.706+0000 7f6db9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 0x7f6dac0e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43872/0 (socket says 172.21.15.42:43872) 2024-08-17T02:27:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.706+0000 7f6db9200640 1 -- 172.21.15.42:0/3613234699 learned_addr learned my addr 172.21.15.42:0/3613234699 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.706+0000 7f6db3e00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dac054340 0x7f6dac0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7f6db9200640 1 -- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dac0e1ef0 msgr2=0x7f6dac0dc190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7ff53a800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 0x7ff53415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7ff53a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5340ac230 0x7ff5340afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7f6db9200640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dac0e1ef0 0x7f6dac0dc190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7f6db9200640 1 -- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dac054340 msgr2=0x7f6dac0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7f6db9200640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dac054340 0x7f6dac0d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7f6db9200640 1 -- 172.21.15.42:0/3613234699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009450 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7f6db3e00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dac054340 0x7f6dac0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7ff53a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5341548e0 0x7ff53406a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7ff539400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 0x7ff53415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.707+0000 7ff539400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 0x7ff53415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35528/0 (socket says 172.21.15.42:35528) 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.708+0000 7ff539400640 1 -- 172.21.15.42:0/3405966272 learned_addr learned my addr 172.21.15.42:0/3405966272 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.708+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53415b380 con 0x7ff5341548e0 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.708+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b1480 con 0x7ff5340ac230 2024-08-17T02:27:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.708+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b0870 con 0x7ff5340ab3a0 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.708+0000 7ff538a00640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5340ac230 0x7ff5340afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7ff539e00640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5341548e0 0x7ff53406a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7ff539400640 1 -- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5340ac230 msgr2=0x7ff5340afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7ff539400640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5340ac230 0x7ff5340afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7ff539400640 1 -- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5341548e0 msgr2=0x7ff53406a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7ff539400640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5341548e0 0x7ff53406a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7ff539400640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c009390 con 0x7ff5340ab3a0 2024-08-17T02:27:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.709+0000 7f6db9200640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 0x7f6dac0e3090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6db40659e0 tx=0x7f6db4088040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.710+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4070870 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.710+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac0e4040 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.710+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac0e4600 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.710+0000 7ff539400640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 0x7ff53415ae40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff52800fb60 tx=0x7ff528007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.710+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db40709d0 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.711+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db408e610 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.711+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800dbd0 con 0x7ff5340ab3a0 2024-08-17T02:27:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.711+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52800dd30 con 0x7ff5340ab3a0 2024-08-17T02:27:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.711+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800dea0 con 0x7ff5340ab3a0 2024-08-17T02:27:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.712+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d90005210 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.711+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5340b0b50 con 0x7ff5340ab3a0 2024-08-17T02:27:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.711+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5340b1110 con 0x7ff5340ab3a0 2024-08-17T02:27:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.713+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534070720 con 0x7ff5340ab3a0 2024-08-17T02:27:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.714+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6db4096360 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.718+0000 7f6da7400640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6d94065180 0x7f6d94067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.719+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6db40f8830 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.719+0000 7f6db3e00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6d94065180 0x7f6d94067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.721+0000 7f6db3e00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6d94065180 0x7f6d94067630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6da0001950 tx=0x7f6da0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.723+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6db40c6900 con 0x7f6dac0dc6d0 2024-08-17T02:27:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.722+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff528025480 con 0x7ff5340ab3a0 2024-08-17T02:27:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.723+0000 7ff530c00640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff5140652d0 0x7ff514067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.724+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff528016030 con 0x7ff5340ab3a0 2024-08-17T02:27:33.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.724+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff528082e60 con 0x7ff5340ab3a0 2024-08-17T02:27:33.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.724+0000 7ff538a00640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff5140652d0 0x7ff514067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.726+0000 7ff538a00640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff5140652d0 0x7ff514067780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff520007fd0 tx=0x7ff520009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.772+0000 7f813c400640 1 Processor -- start 2024-08-17T02:27:33.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.773+0000 7f813c400640 1 -- start start 2024-08-17T02:27:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.774+0000 7f2a4b600640 1 Processor -- start 2024-08-17T02:27:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.774+0000 7f2a4b600640 1 -- start start 2024-08-17T02:27:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.774+0000 7f813c400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b1df0 0x7f81340b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f813c400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81340ca930 0x7f81340b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f813c400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f81340b3000 0x7f8134158770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f813c400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340b34a0 con 0x7f81340b3000 2024-08-17T02:27:33.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f813c400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340b3780 con 0x7f81340ca930 2024-08-17T02:27:33.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f813c400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b3a60 con 0x7f81340b1df0 2024-08-17T02:27:33.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f8139a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b1df0 0x7f81340b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.775+0000 7f8139000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81340ca930 0x7f81340b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f8139000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f81340ca930 0x7f81340b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41222/0 (socket says 172.21.15.42:41222) 2024-08-17T02:27:33.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f8139000640 1 -- 172.21.15.42:0/3059222084 learned_addr learned my addr 172.21.15.42:0/3059222084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f813a400640 1 --2- 172.21.15.42:0/3059222084 >> v2:172.21.15.42:3300/0 conn(0x7f81340b3000 0x7f8134158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f2a4b600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2a440cb0d0 0x7f2a44158db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f2a4b600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440af9a0 con 0x7f2a440cda30 2024-08-17T02:27:33.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f2a4b600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440ce740 con 0x7f2a441589e0 2024-08-17T02:27:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f2a4b600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440af810 con 0x7f2a440cb0d0 2024-08-17T02:27:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f2a49600640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2a440cda30 0x7f2a440cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56606/0 (socket says 172.21.15.42:56606) 2024-08-17T02:27:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.776+0000 7f2a49600640 1 -- 172.21.15.42:0/2197697974 learned_addr learned my addr 172.21.15.42:0/2197697974 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f8139000640 1 -- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b1df0 msgr2=0x7f81340b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f8139000640 1 --2- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b1df0 0x7f81340b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a3be00640 1 --2- 172.21.15.42:0/2197697974 >> v2:172.21.15.42:3300/0 conn(0x7f2a440cb0d0 0x7f2a44158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308779141 0 0) 0x7f2a440ce740 con 0x7f2a441589e0 2024-08-17T02:27:33.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a280034e0 con 0x7f2a441589e0 2024-08-17T02:27:33.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f8139000640 1 -- 172.21.15.42:0/3059222084 >> v2:172.21.15.42:3300/0 conn(0x7f81340b3000 msgr2=0x7f8134158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f8139000640 1 --2- 172.21.15.42:0/3059222084 >> v2:172.21.15.42:3300/0 conn(0x7f81340b3000 0x7f8134158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f8139000640 1 -- 172.21.15.42:0/3059222084 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340b3d40 con 0x7f81340ca930 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492408290 0 0) 0x7f2a440af9a0 con 0x7f2a440cda30 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a440ce740 con 0x7f2a440cda30 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122516901 0 0) 0x7f2a280034e0 con 0x7f2a441589e0 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 >> v2:172.21.15.42:3300/0 conn(0x7f2a440cb0d0 msgr2=0x7f2a44158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 --2- 172.21.15.42:0/2197697974 >> v2:172.21.15.42:3300/0 conn(0x7f2a440cb0d0 0x7f2a44158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 >> v1:172.21.15.42:6789/0 conn(0x7f2a440cda30 legacy=0x7f2a440cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440cea00 con 0x7f2a441589e0 2024-08-17T02:27:33.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f2a34001470 con 0x7f2a441589e0 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 >> v1:172.21.15.62:6789/0 conn(0x7f2a441589e0 legacy=0x7f2a440ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.777+0000 7f2a43e00640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28003b60 0x7f2a28003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a43e00640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a28004780 0x7f2a28004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a43e00640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a280051a0 0x7f2a2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440af810 con 0x7f2a280051a0 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2800c0d0 con 0x7f2a28003b60 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2800c290 con 0x7f2a28004780 2024-08-17T02:27:33.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f813a400640 1 --2- 172.21.15.42:0/3059222084 >> v2:172.21.15.42:3300/0 conn(0x7f81340b3000 0x7f8134158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a49600640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a280051a0 0x7f2a2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.778+0000 7f2a48c00640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28003b60 0x7f2a28003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.779+0000 7f2a49600640 1 -- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a28004780 msgr2=0x7f2a28004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.779+0000 7f2a49600640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a28004780 0x7f2a28004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.779+0000 7f2a49600640 1 -- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28003b60 msgr2=0x7f2a28003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.779+0000 7f2a49600640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a28003b60 0x7f2a28003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.779+0000 7f2a49600640 1 -- 172.21.15.42:0/2197697974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440cea00 con 0x7f2a280051a0 2024-08-17T02:27:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.780+0000 7f91cf200640 1 Processor -- start 2024-08-17T02:27:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f2a49600640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a280051a0 0x7f2a2800b9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c390 tx=0x7f2a3c001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4c008a5e4160f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f2a49600640 1 -- 172.21.15.42:0/2197697974 reap_dead start 2024-08-17T02:27:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f8139000640 1 --2- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340b2ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81340696d0 tx=0x7f81280091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b43306ba3355bf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0070f0 con 0x7f2a280051a0 2024-08-17T02:27:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c02d070 con 0x7f2a280051a0 2024-08-17T02:27:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f2a43e00640 1 -- 172.21.15.42:0/2197697974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c007270 con 0x7f2a280051a0 2024-08-17T02:27:33.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f8133e00640 1 -- 172.21.15.42:0/3059222084 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812802ad30 con 0x7f81340ca930 2024-08-17T02:27:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f8133e00640 1 -- 172.21.15.42:0/3059222084 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812802ae90 con 0x7f81340ca930 2024-08-17T02:27:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f8133e00640 1 -- 172.21.15.42:0/3059222084 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8128032670 con 0x7f81340ca930 2024-08-17T02:27:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.781+0000 7f91cf200640 1 -- start start 2024-08-17T02:27:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.782+0000 7f2a4b600640 1 -- 172.21.15.42:0/2197697974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a280051a0 msgr2=0x7f2a2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.782+0000 7f2a4b600640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a280051a0 0x7f2a2800b9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c390 tx=0x7f2a3c001b90 comp rx=0 tx=0).stop 2024-08-17T02:27:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.783+0000 7f91cf200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91c80b03c0 0x7f91c80b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.783+0000 7f2a4b600640 1 -- 172.21.15.42:0/2197697974 shutdown_connections 2024-08-17T02:27:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.783+0000 7f2a4b600640 1 --2- 172.21.15.42:0/2197697974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a280051a0 0x7f2a2800b9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.783+0000 7f2a4b600640 1 -- 172.21.15.42:0/2197697974 >> 172.21.15.42:0/2197697974 conn(0x7f2a4406e590 msgr2=0x7f2a4406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.783+0000 7f813c400640 1 -- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 msgr2=0x7f81340b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.783+0000 7f813c400640 1 --2- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340b2ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81340696d0 tx=0x7f81280091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f2a4b600640 1 -- 172.21.15.42:0/2197697974 shutdown_connections 2024-08-17T02:27:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f2a4b600640 1 -- 172.21.15.42:0/2197697974 wait complete. 2024-08-17T02:27:33.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 -- 172.21.15.42:0/3059222084 shutdown_connections 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 --2- 172.21.15.42:0/3059222084 >> v2:172.21.15.42:3300/0 conn(0x7f81340b3000 0x7f8134158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 --2- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340b2ac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 --2- 172.21.15.42:0/3059222084 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b1df0 0x7f81340b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 -- 172.21.15.42:0/3059222084 >> 172.21.15.42:0/3059222084 conn(0x7f813406e590 msgr2=0x7f813406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 -- 172.21.15.42:0/3059222084 shutdown_connections 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f91cf200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f91c806d7d0 0x7f91c806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f91cf200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c80aff30 con 0x7f91c815cdc0 2024-08-17T02:27:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f91cf200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c806e150 con 0x7f91c806d7d0 2024-08-17T02:27:33.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f91cf200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80af320 con 0x7f91c80b03c0 2024-08-17T02:27:33.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.784+0000 7f813c400640 1 -- 172.21.15.42:0/3059222084 wait complete. 2024-08-17T02:27:33.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.785+0000 7fc91aa00640 1 Processor -- start 2024-08-17T02:27:33.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.785+0000 7fc91aa00640 1 -- start start 2024-08-17T02:27:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.785+0000 7f91cd200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f91c806d7d0 0x7f91c806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.785+0000 7f91cd200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f91c806d7d0 0x7f91c806dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43906/0 (socket says 172.21.15.42:43906) 2024-08-17T02:27:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7fde9ea00640 1 Processor -- start 2024-08-17T02:27:33.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f6870600640 1 Processor -- start 2024-08-17T02:27:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f813c400640 1 Processor -- start 2024-08-17T02:27:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.787+0000 7f813c400640 1 -- start start 2024-08-17T02:27:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.787+0000 7f2a4b600640 1 Processor -- start 2024-08-17T02:27:33.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.787+0000 7f2a4b600640 1 -- start start 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fc91aa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc91414fe00 0x7fc9140cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.785+0000 7f91cd200640 1 -- 172.21.15.42:0/2584592521 learned_addr learned my addr 172.21.15.42:0/2584592521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.785+0000 7f91c7400640 1 --2- 172.21.15.42:0/2584592521 >> v2:172.21.15.62:3300/0 conn(0x7f91c80b03c0 0x7f91c80b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f91c7400640 1 -- 172.21.15.42:0/2584592521 >> v2:172.21.15.42:3300/0 conn(0x7f91c806d7d0 msgr2=0x7f91c806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f91c7400640 1 --2- 172.21.15.42:0/2584592521 >> v2:172.21.15.42:3300/0 conn(0x7f91c806d7d0 0x7f91c806dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f91c7400640 1 -- 172.21.15.42:0/2584592521 >> v1:172.21.15.62:6789/0 conn(0x7f91c815cdc0 legacy=0x7f91c80ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f91c7400640 1 -- 172.21.15.42:0/2584592521 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80af600 con 0x7f91c80b03c0 2024-08-17T02:27:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7f91c7400640 1 --2- 172.21.15.42:0/2584592521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c80b0840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91c8067bb0 tx=0x7f91b40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8283a7a71c89a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7f6870600640 1 -- start start 2024-08-17T02:27:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fc91aa00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9140cdef0 con 0x7fc9140d0320 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7f6870600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68680aea20 0x7f68680aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7f6870600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f68680ca8e0 0x7f68680cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7f6870600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68680af3a0 con 0x7f6868158b90 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7f6870600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680afd20 con 0x7f68680ca8e0 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7f6870600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680affe0 con 0x7f68680aea20 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.786+0000 7fde9ea00640 1 -- start start 2024-08-17T02:27:33.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fde9ea00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde9814fe00 0x7fde980cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fde9ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 0x7fde980ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fde9ea00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980cdef0 con 0x7fde980cca30 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fde9ea00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980af8e0 con 0x7fde9814fe00 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a4b600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a280051a0 0x7f2a44159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a4b600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 0x7f2a44140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a4b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a44157790 0x7f2a44157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a4b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44158140 con 0x7f2a44157790 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a4b600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b2f20 con 0x7f2a440b2ab0 2024-08-17T02:27:33.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a4b600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440b5030 con 0x7f2a280051a0 2024-08-17T02:27:33.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fde9ea00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980ccf10 con 0x7fde980d0320 2024-08-17T02:27:33.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fde9ca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 0x7fde980ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fde9ca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 0x7fde980ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35560/0 (socket says 172.21.15.42:35560) 2024-08-17T02:27:33.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fde9ca00640 1 -- 172.21.15.42:0/3705488665 learned_addr learned my addr 172.21.15.42:0/3705488665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f813c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b1df0 0x7f8134147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f813c400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b3000 0x7f81340c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f91c6a00640 1 -- 172.21.15.42:0/2584592521 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b402aca0 con 0x7f91c80b03c0 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f91c6a00640 1 -- 172.21.15.42:0/2584592521 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b402ae00 con 0x7f91c80b03c0 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f91c6a00640 1 -- 172.21.15.42:0/2584592521 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4032650 con 0x7f91c80b03c0 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a3be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 0x7f2a44140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7f2a3be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 0x7f2a44140090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41258/0 (socket says 172.21.15.42:41258) 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a3be00640 1 -- 172.21.15.42:0/950056433 learned_addr learned my addr 172.21.15.42:0/950056433 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a48c00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a280051a0 0x7f2a44159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a48c00640 1 -- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 msgr2=0x7f2a44140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a48c00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 0x7f2a44140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a48c00640 1 -- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a44157790 msgr2=0x7f2a44157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a48c00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a44157790 0x7f2a44157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a48c00640 1 -- 172.21.15.42:0/950056433 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440b52d0 con 0x7f2a280051a0 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fc91aa00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9140ccf10 con 0x7fc9140cca30 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fc91aa00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9140af8e0 con 0x7fc91414fe00 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fc918a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc9140d0320 0x7fc9140ce380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56610/0 (socket says 172.21.15.42:56610) 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.789+0000 7fc918a00640 1 -- 172.21.15.42:0/1809426608 learned_addr learned my addr 172.21.15.42:0/1809426608 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fc913e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc91414fe00 0x7fc9140cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.788+0000 7fc913400640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc9140cca30 0x7fc9140cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:44752/0 (socket says 172.21.15.42:44752) 2024-08-17T02:27:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f686d200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68680aea20 0x7f68680aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f686d200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68680aea20 0x7f68680aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41272/0 (socket says 172.21.15.42:41272) 2024-08-17T02:27:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f686d200640 1 -- 172.21.15.42:0/4039033103 learned_addr learned my addr 172.21.15.42:0/4039033103 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7fde9ca00640 1 -- 172.21.15.42:0/3705488665 >> v2:172.21.15.42:3300/0 conn(0x7fde9814fe00 msgr2=0x7fde980cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7fde97e00640 1 --2- 172.21.15.42:0/3705488665 >> v2:172.21.15.42:3300/0 conn(0x7fde9814fe00 0x7fde980cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7fde9ca00640 1 --2- 172.21.15.42:0/3705488665 >> v2:172.21.15.42:3300/0 conn(0x7fde9814fe00 0x7fde980cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f813c400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f91cf200640 1 -- 172.21.15.42:0/2584592521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 msgr2=0x7f91c80b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f91cf200640 1 --2- 172.21.15.42:0/2584592521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c80b0840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91c8067bb0 tx=0x7f91b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7fde9ca00640 1 -- 172.21.15.42:0/3705488665 >> v1:172.21.15.42:6789/0 conn(0x7fde980cca30 legacy=0x7fde980cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.790+0000 7f2a3be00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 0x7f2a44140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:33.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f91cf200640 1 -- 172.21.15.42:0/2584592521 shutdown_connections 2024-08-17T02:27:33.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f91cf200640 1 --2- 172.21.15.42:0/2584592521 >> v2:172.21.15.42:3300/0 conn(0x7f91c806d7d0 0x7f91c806dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f91cf200640 1 --2- 172.21.15.42:0/2584592521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c80b0840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f91cf200640 1 -- 172.21.15.42:0/2584592521 >> 172.21.15.42:0/2584592521 conn(0x7f91c8066e60 msgr2=0x7f91c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f686d200640 1 -- 172.21.15.42:0/4039033103 >> v2:172.21.15.42:3300/0 conn(0x7f68680ca8e0 msgr2=0x7f68680cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f686d200640 1 --2- 172.21.15.42:0/4039033103 >> v2:172.21.15.42:3300/0 conn(0x7f68680ca8e0 0x7f68680cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f686d200640 1 -- 172.21.15.42:0/4039033103 >> v1:172.21.15.42:6789/0 conn(0x7f6868158b90 legacy=0x7f68680b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f686d200640 1 -- 172.21.15.42:0/4039033103 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680b02c0 con 0x7f68680aea20 2024-08-17T02:27:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7fde9ca00640 1 -- 172.21.15.42:0/3705488665 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980cdba0 con 0x7fde980d0320 2024-08-17T02:27:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7fc912a00640 1 -- 172.21.15.42:0/1809426608 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479196258 0 0) 0x7fc9140ccf10 con 0x7fc9140cca30 2024-08-17T02:27:33.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7fc912a00640 1 -- 172.21.15.42:0/1809426608 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f80034e0 con 0x7fc9140cca30 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f8139a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b1df0 0x7f8134147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f813a400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f8139a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b1df0 0x7f8134147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43924/0 (socket says 172.21.15.42:43924) 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f8139a00640 1 -- 172.21.15.42:0/1233499030 learned_addr learned my addr 172.21.15.42:0/1233499030 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134148250 con 0x7f81340b1df0 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134147640 con 0x7f81340ca930 2024-08-17T02:27:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8134147920 con 0x7f81340b3000 2024-08-17T02:27:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7fc913e00640 1 -- 172.21.15.42:0/1809426608 >> v1:172.21.15.62:6789/0 conn(0x7fc9140cca30 legacy=0x7fc9140cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7fc913e00640 1 -- 172.21.15.42:0/1809426608 >> v1:172.21.15.42:6789/0 conn(0x7fc9140d0320 legacy=0x7fc9140ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f8139000640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b3000 0x7f81340c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f91cf200640 1 -- 172.21.15.42:0/2584592521 shutdown_connections 2024-08-17T02:27:33.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f91cf200640 1 -- 172.21.15.42:0/2584592521 wait complete. 2024-08-17T02:27:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.791+0000 7fc913e00640 1 -- 172.21.15.42:0/1809426608 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140cdba0 con 0x7fc91414fe00 2024-08-17T02:27:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7fde97e00640 1 --2- 172.21.15.42:0/3705488665 >> v2:172.21.15.42:3300/0 conn(0x7fde9814fe00 0x7fde980cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:33.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f2a48c00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a280051a0 0x7f2a44159440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a34002ee0 tx=0x7f2a340077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f813a400640 1 -- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b3000 msgr2=0x7f81340c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f813a400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b3000 0x7f81340c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f813a400640 1 -- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b1df0 msgr2=0x7f8134147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f813a400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b1df0 0x7f8134147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400d910 con 0x7f2a280051a0 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400da90 con 0x7f2a280051a0 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400de50 con 0x7f2a280051a0 2024-08-17T02:27:33.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7fde9ca00640 1 --2- 172.21.15.42:0/3705488665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 0x7fde980ce380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde90009910 tx=0x7fde900091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d8b733ea674a64 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.792+0000 7f813a400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128009450 con 0x7f81340ca930 2024-08-17T02:27:33.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f813a400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340c28a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f812000d890 tx=0x7f8120008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7fc913e00640 1 --2- 172.21.15.42:0/1809426608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc91414fe00 0x7fc9140cc4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc904009850 tx=0x7fc9040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ee5fbfe9e9b134 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a440b55b0 con 0x7f2a280051a0 2024-08-17T02:27:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a44159a40 con 0x7f2a280051a0 2024-08-17T02:27:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000b6c0 con 0x7f81340ca930 2024-08-17T02:27:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f686d200640 1 --2- 172.21.15.42:0/4039033103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680aea20 0x7f68680aee60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6868066fc0 tx=0x7f68540091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a510d4a1d3aed1b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7fc912a00640 1 -- 172.21.15.42:0/1809426608 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90402ad00 con 0x7fc91414fe00 2024-08-17T02:27:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7fde97400640 1 -- 172.21.15.42:0/3705488665 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9002ad30 con 0x7fde980d0320 2024-08-17T02:27:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7fc912a00640 1 -- 172.21.15.42:0/1809426608 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90402ae60 con 0x7fc91414fe00 2024-08-17T02:27:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.793+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8134147c00 con 0x7f81340ca930 2024-08-17T02:27:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81340c9860 con 0x7f81340ca930 2024-08-17T02:27:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7fc912a00640 1 -- 172.21.15.42:0/1809426608 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904032670 con 0x7fc91414fe00 2024-08-17T02:27:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f6867e00640 1 -- 172.21.15.42:0/4039033103 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685402ade0 con 0x7f68680aea20 2024-08-17T02:27:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f6867e00640 1 -- 172.21.15.42:0/4039033103 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6854032440 con 0x7f68680aea20 2024-08-17T02:27:33.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f6867e00640 1 -- 172.21.15.42:0/4039033103 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854032820 con 0x7f68680aea20 2024-08-17T02:27:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000b820 con 0x7f81340ca930 2024-08-17T02:27:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000b6c0 con 0x7f81340ca930 2024-08-17T02:27:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7fc91aa00640 1 -- 172.21.15.42:0/1809426608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc91414fe00 msgr2=0x7fc9140cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7fc91aa00640 1 --2- 172.21.15.42:0/1809426608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc91414fe00 0x7fc9140cc4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc904009850 tx=0x7fc9040090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f91cf200640 1 Processor -- start 2024-08-17T02:27:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7f91cf200640 1 -- start start 2024-08-17T02:27:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7f6870600640 1 -- 172.21.15.42:0/4039033103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680aea20 msgr2=0x7f68680aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7f6870600640 1 --2- 172.21.15.42:0/4039033103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680aea20 0x7f68680aee60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6868066fc0 tx=0x7f68540091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7fc91aa00640 1 -- 172.21.15.42:0/1809426608 shutdown_connections 2024-08-17T02:27:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7fc91aa00640 1 --2- 172.21.15.42:0/1809426608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc91414fe00 0x7fc9140cc4f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7fc91aa00640 1 -- 172.21.15.42:0/1809426608 >> 172.21.15.42:0/1809426608 conn(0x7fc914068680 msgr2=0x7fc914068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.795+0000 7fc91aa00640 1 -- 172.21.15.42:0/1809426608 shutdown_connections 2024-08-17T02:27:33.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f6870600640 1 -- 172.21.15.42:0/4039033103 shutdown_connections 2024-08-17T02:27:33.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f6870600640 1 --2- 172.21.15.42:0/4039033103 >> v2:172.21.15.42:3300/0 conn(0x7f68680ca8e0 0x7f68680cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f6870600640 1 --2- 172.21.15.42:0/4039033103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680aea20 0x7f68680aee60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f6870600640 1 -- 172.21.15.42:0/4039033103 >> 172.21.15.42:0/4039033103 conn(0x7f686806e590 msgr2=0x7f686806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f91cf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91c806d7d0 0x7f91c80abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f91cf200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c8170fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f91cf200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91c815cdc0 0x7f91c8147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7fde97400640 1 -- 172.21.15.42:0/3705488665 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9002ae90 con 0x7fde980d0320 2024-08-17T02:27:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.794+0000 7fde97400640 1 -- 172.21.15.42:0/3705488665 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90032670 con 0x7fde980d0320 2024-08-17T02:27:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f6870600640 1 -- 172.21.15.42:0/4039033103 shutdown_connections 2024-08-17T02:27:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f91c7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c8170fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7fc91aa00640 1 -- 172.21.15.42:0/1809426608 wait complete. 2024-08-17T02:27:33.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f91c7400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c8170fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41296/0 (socket says 172.21.15.42:41296) 2024-08-17T02:27:33.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.796+0000 7f6870600640 1 -- 172.21.15.42:0/4039033103 wait complete. 2024-08-17T02:27:33.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.797+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2a34014680 con 0x7f2a280051a0 2024-08-17T02:27:33.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.797+0000 7fde9ea00640 1 -- 172.21.15.42:0/3705488665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 msgr2=0x7fde980ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.797+0000 7fde9ea00640 1 --2- 172.21.15.42:0/3705488665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 0x7fde980ce380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde90009910 tx=0x7fde900091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f91c7400640 1 -- 172.21.15.42:0/2135895131 learned_addr learned my addr 172.21.15.42:0/2135895131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80aa160 con 0x7f91c806d7d0 2024-08-17T02:27:33.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80ac2b0 con 0x7f91c80b03c0 2024-08-17T02:27:33.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80a9550 con 0x7f91c815cdc0 2024-08-17T02:27:33.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.797+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8110005210 con 0x7f81340ca930 2024-08-17T02:27:33.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f91c7e00640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91c806d7d0 0x7f91c80abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f812000bbe0 con 0x7f81340ca930 2024-08-17T02:27:33.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f91cd200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91c815cdc0 0x7f91c8147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f2a40c00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2a20065220 0x7f2a200676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.798+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a34082be0 con 0x7f2a280051a0 2024-08-17T02:27:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f91cd200640 1 -- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 msgr2=0x7f91c8170fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7fc91aa00640 1 Processor -- start 2024-08-17T02:27:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f91cd200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c8170fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7fde9ea00640 1 -- 172.21.15.42:0/3705488665 shutdown_connections 2024-08-17T02:27:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7fde9ea00640 1 --2- 172.21.15.42:0/3705488665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980d0320 0x7fde980ce380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7fde9ea00640 1 --2- 172.21.15.42:0/3705488665 >> v2:172.21.15.42:3300/0 conn(0x7fde9814fe00 0x7fde980cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7fc91aa00640 1 -- start start 2024-08-17T02:27:33.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7fde9ea00640 1 -- 172.21.15.42:0/3705488665 >> 172.21.15.42:0/3705488665 conn(0x7fde98068680 msgr2=0x7fde98068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:33.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f6870600640 1 Processor -- start 2024-08-17T02:27:33.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f91cd200640 1 -- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91c806d7d0 msgr2=0x7f91c80abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f91cd200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91c806d7d0 0x7f91c80abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f91cd200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4009390 con 0x7f91c815cdc0 2024-08-17T02:27:33.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f91c7e00640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91c806d7d0 0x7f91c80abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:33.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f6870600640 1 -- start start 2024-08-17T02:27:33.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.799+0000 7f2a3be00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2a20065220 0x7f2a200676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f8130c00640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8114065260 0x7f8114067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f91cd200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91c815cdc0 0x7f91c8147290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91c0007ba0 tx=0x7f91c0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000da50 con 0x7f91c815cdc0 2024-08-17T02:27:33.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c000f040 con 0x7f91c815cdc0 2024-08-17T02:27:33.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000de00 con 0x7f91c815cdc0 2024-08-17T02:27:33.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44063fb0 con 0x7f2a280051a0 2024-08-17T02:27:33.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8120082650 con 0x7f81340ca930 2024-08-17T02:27:33.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f6870600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 0x7f68680c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f6870600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680ca8e0 0x7f6868158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f6870600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6868158b90 0x7f686815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.800+0000 7f8139a00640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8114065260 0x7f8114067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7fc91aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cca30 0x7fc91414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7fde9ea00640 1 -- 172.21.15.42:0/3705488665 shutdown_connections 2024-08-17T02:27:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c80a9830 con 0x7f91c815cdc0 2024-08-17T02:27:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f6870600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680c7c70 con 0x7f6868158b90 2024-08-17T02:27:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f6870600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868168d10 con 0x7f68680ca8e0 2024-08-17T02:27:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f6870600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68680c7f10 con 0x7f68680aea20 2024-08-17T02:27:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f686dc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 0x7f68680c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c80a9df0 con 0x7f91c815cdc0 2024-08-17T02:27:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f686dc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 0x7f68680c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35598/0 (socket says 172.21.15.42:35598) 2024-08-17T02:27:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f686dc00640 1 -- 172.21.15.42:0/1893874120 learned_addr learned my addr 172.21.15.42:0/1893874120 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7fc91aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9140d0320 0x7fc91414c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7fc91aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc91414fe00 0x7fc9140c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f686d200640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680ca8e0 0x7f6868158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.801+0000 7f686e600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6868158b90 0x7f686815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fc91aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91414ef30 con 0x7fc9140d0320 2024-08-17T02:27:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fde9ea00640 1 -- 172.21.15.42:0/3705488665 wait complete. 2024-08-17T02:27:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fc91aa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140c79d0 con 0x7fc9140cca30 2024-08-17T02:27:33.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fc91aa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc914140100 con 0x7fc91414fe00 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686dc00640 1 -- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680ca8e0 msgr2=0x7f6868158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686dc00640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680ca8e0 0x7f6868158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686dc00640 1 -- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6868158b90 msgr2=0x7f686815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686dc00640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6868158b90 0x7f686815ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686dc00640 1 -- 172.21.15.42:0/1893874120 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009450 con 0x7f68680aea20 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fc918a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc91414fe00 0x7fc9140c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fc918a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc91414fe00 0x7fc9140c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35600/0 (socket says 172.21.15.42:35600) 2024-08-17T02:27:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7fc918a00640 1 -- 172.21.15.42:0/3675342714 learned_addr learned my addr 172.21.15.42:0/3675342714 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686e600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6868158b90 0x7f686815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f2a3be00640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2a20065220 0x7f2a200676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a4415be30 tx=0x7f2a2c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.802+0000 7f686dc00640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 0x7f68680c7730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f685c00bbb0 tx=0x7f685c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c80aa310 con 0x7f91c815cdc0 2024-08-17T02:27:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913e00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cca30 0x7fc91414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7f8139a00640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8114065260 0x7f8114067710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f813406e560 tx=0x7f812c009920 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913400640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9140d0320 0x7fc91414c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913e00640 1 -- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc91414fe00 msgr2=0x7fc9140c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913e00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc91414fe00 0x7fc9140c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913e00640 1 -- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9140d0320 msgr2=0x7fc91414c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913e00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9140d0320 0x7fc91414c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.803+0000 7fc913e00640 1 -- 172.21.15.42:0/3675342714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904009390 con 0x7fc9140cca30 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.804+0000 7fc913e00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cca30 0x7fc91414bec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc904031000 tx=0x7fc904032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.804+0000 7fde9ea00640 1 Processor -- start 2024-08-17T02:27:33.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.804+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8120050670 con 0x7f81340ca930 2024-08-17T02:27:33.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.804+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904031700 con 0x7fc9140cca30 2024-08-17T02:27:33.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.804+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9140c6dc0 con 0x7fc9140cca30 2024-08-17T02:27:33.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.804+0000 7fde9ea00640 1 -- start start 2024-08-17T02:27:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.805+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904031860 con 0x7fc9140cca30 2024-08-17T02:27:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.805+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904031700 con 0x7fc9140cca30 2024-08-17T02:27:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.805+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9140c7380 con 0x7fc9140cca30 2024-08-17T02:27:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2a34050c80 con 0x7f2a280051a0 2024-08-17T02:27:33.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc914063fb0 con 0x7fc9140cca30 2024-08-17T02:27:33.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0092e0 con 0x7f68680aea20 2024-08-17T02:27:33.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c00c860 con 0x7f68680aea20 2024-08-17T02:27:33.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00cc20 con 0x7f68680aea20 2024-08-17T02:27:33.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68680c81f0 con 0x7f68680aea20 2024-08-17T02:27:33.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68680c87b0 con 0x7f68680aea20 2024-08-17T02:27:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7fde9ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980cca30 0x7fde9814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7fde9ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde980d0320 0x7fde9815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.806+0000 7fde9ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde9814fe00 0x7fde9815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde97e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980cca30 0x7fde9814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde97e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980cca30 0x7fde9814b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35610/0 (socket says 172.21.15.42:35610) 2024-08-17T02:27:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.808+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6868063fb0 con 0x7f68680aea20 2024-08-17T02:27:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde97e00640 1 -- 172.21.15.42:0/2878814746 learned_addr learned my addr 172.21.15.42:0/2878814746 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde9ea00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c7160 con 0x7fde9814fe00 2024-08-17T02:27:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde9ea00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98170e30 con 0x7fde980d0320 2024-08-17T02:27:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde9ea00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c7f30 con 0x7fde980cca30 2024-08-17T02:27:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde8f400640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde980d0320 0x7fde9815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.807+0000 7fde9ca00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde9814fe00 0x7fde9815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.808+0000 7fde8f400640 1 -- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980cca30 msgr2=0x7fde9814b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.808+0000 7fde8f400640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980cca30 0x7fde9814b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.808+0000 7fde8f400640 1 -- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde9814fe00 msgr2=0x7fde9815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.808+0000 7fde8f400640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde9814fe00 0x7fde9815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.808+0000 7fde8f400640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90009450 con 0x7fde980d0320 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.809+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc904039040 con 0x7fc9140cca30 2024-08-17T02:27:33.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.809+0000 7fde8f400640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde980d0320 0x7fde9815f1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde8000b490 tx=0x7fde80006f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.810+0000 7fc90b400640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc8f0065260 0x7fc8f0067710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.810+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f91c001f440 con 0x7f91c815cdc0 2024-08-17T02:27:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.810+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9040a22e0 con 0x7fc9140cca30 2024-08-17T02:27:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.811+0000 7fc913400640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc8f0065260 0x7fc8f0067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.811+0000 7fc913400640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc8f0065260 0x7fc8f0067710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc007fd0 tx=0x7fc8fc000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.812+0000 7f91bf400640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91a80652d0 0x7f91a8067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.812+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91c0082880 con 0x7f91c815cdc0 2024-08-17T02:27:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.812+0000 7f91c7e00640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91a80652d0 0x7f91a8067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.812+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91c00ade40 con 0x7f91c815cdc0 2024-08-17T02:27:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.813+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f685c012070 con 0x7f68680aea20 2024-08-17T02:27:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.813+0000 7f6864c00640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68480652a0 0x7f6848067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f685c0827c0 con 0x7f68680aea20 2024-08-17T02:27:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000f510 con 0x7fde980d0320 2024-08-17T02:27:33.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7f686d200640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68480652a0 0x7f6848067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000f670 con 0x7fde980d0320 2024-08-17T02:27:33.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000fa30 con 0x7fde980d0320 2024-08-17T02:27:33.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7fde9ea00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980c7970 con 0x7fde980d0320 2024-08-17T02:27:33.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.814+0000 7fde9ea00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9814beb0 con 0x7fde980d0320 2024-08-17T02:27:33.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.815+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f685c0508e0 con 0x7f68680aea20 2024-08-17T02:27:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.815+0000 7f91c7e00640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91a80652d0 0x7f91a8067780 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e40 tx=0x7f91b8006f50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.815+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9040703b0 con 0x7fc9140cca30 2024-08-17T02:27:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.817+0000 7f686d200640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68480652a0 0x7f6848067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6854034000 tx=0x7f6854032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.818+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde68005210 con 0x7fde980d0320 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.820+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde8001a400 con 0x7fde980d0320 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.821+0000 7fde8fe00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde740652a0 0x7fde74067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.822+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde80081e60 con 0x7fde980d0320 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.822+0000 7fde97e00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde740652a0 0x7fde74067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.823+0000 7fde97e00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde740652a0 0x7fde74067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde8800e720 tx=0x7fde880077d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:33.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:33.825+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde8004ff80 con 0x7fde980d0320 2024-08-17T02:27:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.135+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d900054c0 con 0x7f6dac0dc6d0 2024-08-17T02:27:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.136+0000 7f6da7400640 1 -- 172.21.15.42:0/3613234699 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6db40c9f20 con 0x7f6dac0dc6d0 2024-08-17T02:27:34.136 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.139+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6d94065180 msgr2=0x7f6d94067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.140+0000 7f6db9c00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6d94065180 0x7f6d94067630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6da0001950 tx=0x7f6da0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.140+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 msgr2=0x7f6dac0e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.140+0000 7f6db9c00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 0x7f6dac0e3090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6db40659e0 tx=0x7f6db4088040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 shutdown_connections 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6d94065180 0x7f6d94067630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dac0dc6d0 0x7f6dac0e3090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dac0e1ef0 0x7f6dac0dc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 --2- 172.21.15.42:0/3613234699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dac054340 0x7f6dac0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 >> 172.21.15.42:0/3613234699 conn(0x7f6dac055a10 msgr2=0x7f6dac038d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 shutdown_connections 2024-08-17T02:27:34.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.141+0000 7f6db9c00640 1 -- 172.21.15.42:0/3613234699 wait complete. 2024-08-17T02:27:34.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.143+0000 7ff53a800640 1 -- 172.21.15.42:0/3405966272 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff5340c7ca0 con 0x7ff5340ab3a0 2024-08-17T02:27:34.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.144+0000 7ff530c00640 1 -- 172.21.15.42:0/3405966272 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff528020090 con 0x7ff5340ab3a0 2024-08-17T02:27:34.147 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.147+0000 7ff526000640 1 -- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff5140652d0 msgr2=0x7ff514067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.147+0000 7ff526000640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff5140652d0 0x7ff514067780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff520007fd0 tx=0x7ff520009040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.147+0000 7ff526000640 1 -- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 msgr2=0x7ff53415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.147+0000 7ff526000640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 0x7ff53415ae40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff52800fb60 tx=0x7ff528007df0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.148+0000 7ff526000640 1 -- 172.21.15.42:0/3405966272 shutdown_connections 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.148+0000 7ff526000640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff5140652d0 0x7ff514067780 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff520007fd0 tx=0x7ff520009040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.148+0000 7ff526000640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5341548e0 0x7ff53406a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.148+0000 7ff526000640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5340ac230 0x7ff5340afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.148+0000 7ff526000640 1 --2- 172.21.15.42:0/3405966272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff5340ab3a0 0x7ff53415ae40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.148+0000 7ff526000640 1 -- 172.21.15.42:0/3405966272 >> 172.21.15.42:0/3405966272 conn(0x7ff5340cb780 msgr2=0x7ff5340cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.149+0000 7ff526000640 1 -- 172.21.15.42:0/3405966272 shutdown_connections 2024-08-17T02:27:34.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.149+0000 7ff526000640 1 -- 172.21.15.42:0/3405966272 wait complete. 2024-08-17T02:27:34.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-08-17T02:27:34.169 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-08-17T02:27:34.176 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.195+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f91c80aa2d0 con 0x7f91c815cdc0 2024-08-17T02:27:34.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.196+0000 7f91bf400640 1 -- 172.21.15.42:0/2135895131 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91c001a070 con 0x7f91c815cdc0 2024-08-17T02:27:34.196 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:34.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.197+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6868067690 con 0x7f68680aea20 2024-08-17T02:27:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91a80652d0 msgr2=0x7f91a8067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91a80652d0 0x7f91a8067780 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009e40 tx=0x7f91b8006f50 comp rx=0 tx=0).stop 2024-08-17T02:27:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91c815cdc0 msgr2=0x7f91c8147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91c815cdc0 0x7f91c8147290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f91c0007ba0 tx=0x7f91c0009250 comp rx=0 tx=0).stop 2024-08-17T02:27:34.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f6864c00640 1 -- 172.21.15.42:0/1893874120 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f685c053f00 con 0x7f68680aea20 2024-08-17T02:27:34.199 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 shutdown_connections 2024-08-17T02:27:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91a80652d0 0x7f91a8067780 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91c815cdc0 0x7f91c8147290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91c80b03c0 0x7f91c8170fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 --2- 172.21.15.42:0/2135895131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91c806d7d0 0x7f91c80abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 >> 172.21.15.42:0/2135895131 conn(0x7f91c8066e60 msgr2=0x7f91c8159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 shutdown_connections 2024-08-17T02:27:34.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.198+0000 7f91cf200640 1 -- 172.21.15.42:0/2135895131 wait complete. 2024-08-17T02:27:34.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68480652a0 msgr2=0x7f6848067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68480652a0 0x7f6848067750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6854034000 tx=0x7f6854032000 comp rx=0 tx=0).stop 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 msgr2=0x7f68680c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 0x7f68680c7730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f685c00bbb0 tx=0x7f685c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 shutdown_connections 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68480652a0 0x7f6848067750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6868158b90 0x7f686815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68680ca8e0 0x7f6868158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 --2- 172.21.15.42:0/1893874120 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68680aea20 0x7f68680c7730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 >> 172.21.15.42:0/1893874120 conn(0x7f686806e590 msgr2=0x7f686815f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 shutdown_connections 2024-08-17T02:27:34.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.201+0000 7f6870600640 1 -- 172.21.15.42:0/1893874120 wait complete. 2024-08-17T02:27:34.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-17T02:27:34.216 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-08-17T02:27:34.219 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.226+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f81100054c0 con 0x7f81340ca930 2024-08-17T02:27:34.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.226+0000 7f8130c00640 1 -- 172.21.15.42:0/1233499030 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8120053c90 con 0x7f81340ca930 2024-08-17T02:27:34.226 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8114065260 msgr2=0x7f8114067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8114065260 0x7f8114067710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f813406e560 tx=0x7f812c009920 comp rx=0 tx=0).stop 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 msgr2=0x7f81340c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340c28a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f812000d890 tx=0x7f8120008040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 shutdown_connections 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8114065260 0x7f8114067710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81340ca930 0x7f81340c28a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f81340b3000 0x7f81340c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 --2- 172.21.15.42:0/1233499030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81340b1df0 0x7f8134147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.229+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 >> 172.21.15.42:0/1233499030 conn(0x7f813406e590 msgr2=0x7f81340cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.230+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 shutdown_connections 2024-08-17T02:27:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.230+0000 7f813c400640 1 -- 172.21.15.42:0/1233499030 wait complete. 2024-08-17T02:27:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.231+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a440c58f0 con 0x7f2a280051a0 2024-08-17T02:27:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.231+0000 7f2a40c00640 1 -- 172.21.15.42:0/950056433 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a340542a0 con 0x7f2a280051a0 2024-08-17T02:27:34.232 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2a20065220 msgr2=0x7f2a200676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2a20065220 0x7f2a200676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a4415be30 tx=0x7f2a2c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a280051a0 msgr2=0x7f2a44159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a280051a0 0x7f2a44159440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a34002ee0 tx=0x7f2a340077a0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 shutdown_connections 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2a20065220 0x7f2a200676d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a44157790 0x7f2a44157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a440b2ab0 0x7f2a44140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 --2- 172.21.15.42:0/950056433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a280051a0 0x7f2a44159440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 >> 172.21.15.42:0/950056433 conn(0x7f2a4406e590 msgr2=0x7f2a440cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 shutdown_connections 2024-08-17T02:27:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.235+0000 7f2a4b600640 1 -- 172.21.15.42:0/950056433 wait complete. 2024-08-17T02:27:34.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.237+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc91414aaf0 con 0x7fc9140cca30 2024-08-17T02:27:34.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.238+0000 7fc90b400640 1 -- 172.21.15.42:0/3675342714 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc904033040 con 0x7fc9140cca30 2024-08-17T02:27:34.238 INFO:teuthology.orchestra.run.smithi042.stdout:55834574853 2024-08-17T02:27:34.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.239+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fde680054c0 con 0x7fde980d0320 2024-08-17T02:27:34.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.240+0000 7fde8fe00640 1 -- 172.21.15.42:0/2878814746 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde8004ff80 con 0x7fde980d0320 2024-08-17T02:27:34.240 INFO:teuthology.orchestra.run.smithi042.stdout:55834574852 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc8f0065260 msgr2=0x7fc8f0067710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc8f0065260 0x7fc8f0067710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc007fd0 tx=0x7fc8fc000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cca30 msgr2=0x7fc91414bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cca30 0x7fc91414bec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc904031000 tx=0x7fc904032000 comp rx=0 tx=0).stop 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 shutdown_connections 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc8f0065260 0x7fc8f0067710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc91414fe00 0x7fc9140c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9140d0320 0x7fc91414c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 --2- 172.21.15.42:0/3675342714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cca30 0x7fc91414bec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.241+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 >> 172.21.15.42:0/3675342714 conn(0x7fc914068680 msgr2=0x7fc9140b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.242+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 shutdown_connections 2024-08-17T02:27:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.242+0000 7fc91aa00640 1 -- 172.21.15.42:0/3675342714 wait complete. 2024-08-17T02:27:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde740652a0 msgr2=0x7fde74067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde740652a0 0x7fde74067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde8800e720 tx=0x7fde880077d0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde980d0320 msgr2=0x7fde9815f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde980d0320 0x7fde9815f1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde8000b490 tx=0x7fde80006f50 comp rx=0 tx=0).stop 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 shutdown_connections 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde740652a0 0x7fde74067750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde9814fe00 0x7fde9815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde980d0320 0x7fde9815f1b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 --2- 172.21.15.42:0/2878814746 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde980cca30 0x7fde9814b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 >> 172.21.15.42:0/2878814746 conn(0x7fde98068680 msgr2=0x7fde980cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 shutdown_connections 2024-08-17T02:27:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.243+0000 7fde8cc00640 1 -- 172.21.15.42:0/2878814746 wait complete. 2024-08-17T02:27:34.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-08-17T02:27:34.249 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-08-17T02:27:34.259 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-08-17T02:27:34.261 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-08-17T02:27:34.261 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:34.262 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:27:34.262 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:34.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.454+0000 7f5969200640 1 Processor -- start 2024-08-17T02:27:34.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.454+0000 7f5969200640 1 -- start start 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f5969200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59640ca050 0x7f5964156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f5969200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f596415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f5969200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596415b5e0 con 0x7f59640ad960 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f5969200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59640cb160 con 0x7f59640ca050 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f5969200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640b0d10 con 0x7f59640add30 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f595be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59640ca050 0x7f5964156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f595be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59640ca050 0x7f5964156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43944/0 (socket says 172.21.15.42:43944) 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f595be00640 1 -- 172.21.15.42:0/1331812993 learned_addr learned my addr 172.21.15.42:0/1331812993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.455+0000 7f5962800640 1 --2- 172.21.15.42:0/1331812993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f596415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.456+0000 7f595be00640 1 -- 172.21.15.42:0/1331812993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 msgr2=0x7f596415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.456+0000 7f595be00640 1 --2- 172.21.15.42:0/1331812993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f596415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.456+0000 7f595be00640 1 -- 172.21.15.42:0/1331812993 >> v1:172.21.15.62:6789/0 conn(0x7f59640ad960 legacy=0x7f5964156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.456+0000 7f595be00640 1 -- 172.21.15.42:0/1331812993 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640ca550 con 0x7f59640ca050 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.457+0000 7f595be00640 1 --2- 172.21.15.42:0/1331812993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ca050 0x7f5964156b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f594c009910 tx=0x7f594c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d81432e2cc0a40c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.457+0000 7f5961400640 1 -- 172.21.15.42:0/1331812993 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c032440 con 0x7f59640ca050 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.457+0000 7f5961400640 1 -- 172.21.15.42:0/1331812993 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0325a0 con 0x7f59640ca050 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.457+0000 7f5961400640 1 -- 172.21.15.42:0/1331812993 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c032980 con 0x7f59640ca050 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.457+0000 7f5969200640 1 -- 172.21.15.42:0/1331812993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ca050 msgr2=0x7f5964156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.457+0000 7f5969200640 1 --2- 172.21.15.42:0/1331812993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ca050 0x7f5964156b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f594c009910 tx=0x7f594c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.458+0000 7f5969200640 1 -- 172.21.15.42:0/1331812993 shutdown_connections 2024-08-17T02:27:34.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.458+0000 7f5969200640 1 --2- 172.21.15.42:0/1331812993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f596415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.458+0000 7f5969200640 1 --2- 172.21.15.42:0/1331812993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ca050 0x7f5964156b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.458+0000 7f5969200640 1 -- 172.21.15.42:0/1331812993 >> 172.21.15.42:0/1331812993 conn(0x7f5964066e60 msgr2=0x7f5964067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.458+0000 7f5969200640 1 -- 172.21.15.42:0/1331812993 shutdown_connections 2024-08-17T02:27:34.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.458+0000 7f5969200640 1 -- 172.21.15.42:0/1331812993 wait complete. 2024-08-17T02:27:34.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.459+0000 7f5969200640 1 Processor -- start 2024-08-17T02:27:34.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.459+0000 7f5969200640 1 -- start start 2024-08-17T02:27:34.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5969200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 0x7f5964142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5969200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f59640ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5969200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59640ca050 0x7f59641531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5969200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640abe20 con 0x7f59640ad960 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5969200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640ac9a0 con 0x7f59640ca050 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5969200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59640ac070 con 0x7f59640add30 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5961e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 0x7f5964142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5961e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 0x7f5964142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43958/0 (socket says 172.21.15.42:43958) 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.460+0000 7f5961e00640 1 -- 172.21.15.42:0/3149341621 learned_addr learned my addr 172.21.15.42:0/3149341621 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f595be00640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f59640ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5962800640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59640ca050 0x7f59641531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5961e00640 1 -- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 msgr2=0x7f59640ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5961e00640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f59640ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5961e00640 1 -- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59640ca050 msgr2=0x7f59641531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5961e00640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59640ca050 0x7f59641531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5961e00640 1 -- 172.21.15.42:0/3149341621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c009450 con 0x7f59640ad960 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5962800640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59640ca050 0x7f59641531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5961e00640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 0x7f5964142400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f595400c590 tx=0x7f5954007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954012630 con 0x7f59640ad960 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540127b0 con 0x7f59640ad960 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5954012b70 con 0x7f59640ad960 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59640ac350 con 0x7f59640ad960 2024-08-17T02:27:34.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.461+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964142940 con 0x7f59640ad960 2024-08-17T02:27:34.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.462+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5964063fb0 con 0x7f59640ad960 2024-08-17T02:27:34.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.463+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f595401b400 con 0x7f59640ad960 2024-08-17T02:27:34.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.464+0000 7f5959600640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5940065150 0x7f5940067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.464+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5954081e00 con 0x7f59640ad960 2024-08-17T02:27:34.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.464+0000 7f595be00640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5940065150 0x7f5940067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.465+0000 7f595be00640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5940065150 0x7f5940067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f594c034000 tx=0x7f594c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.468+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f595404fe20 con 0x7f59640ad960 2024-08-17T02:27:34.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.649+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59640acae0 con 0x7f5940065150 2024-08-17T02:27:34.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.657+0000 7f5959600640 1 -- 172.21.15.42:0/3149341621 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264550 (secure 0 0 0) 0x7f594c032710 con 0x7f5940065150 2024-08-17T02:27:34.660 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:27:34.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.660+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5940065150 msgr2=0x7f5940067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.660+0000 7f5969200640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5940065150 0x7f5940067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f594c034000 tx=0x7f594c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:34.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 msgr2=0x7f5964142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 0x7f5964142400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f595400c590 tx=0x7f5954007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 shutdown_connections 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5940065150 0x7f5940067600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59640ca050 0x7f59641531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59640add30 0x7f59640ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 --2- 172.21.15.42:0/3149341621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59640ad960 0x7f5964142400 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 >> 172.21.15.42:0/3149341621 conn(0x7f5964066e60 msgr2=0x7f5964155250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 shutdown_connections 2024-08-17T02:27:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.661+0000 7f5969200640 1 -- 172.21.15.42:0/3149341621 wait complete. 2024-08-17T02:27:34.676 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:27:33.184449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398644,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576076,"statfs":{"total":773094113280,"available":770637901824,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001627"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461874+0000","last_change":"2024-08-17T02:27:25.455330+0000","last_active":"2024-08-17T02:27:25.461874+0000","last_peered":"2024-08-17T02:27:25.461874+0000","last_clean":"2024-08-17T02:27:25.461874+0000","last_became_active":"2024-08-17T02:27:25.455125+0000","last_became_peered":"2024-08-17T02:27:25.455125+0000","last_unstale":"2024-08-17T02:27:25.461874+0000","last_undegraded":"2024-08-17T02:27:25.461874+0000","last_fullsized":"2024-08-17T02:27:25.461874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459752+0000","last_change":"2024-08-17T02:27:25.453226+0000","last_active":"2024-08-17T02:27:25.459752+0000","last_peered":"2024-08-17T02:27:25.459752+0000","last_clean":"2024-08-17T02:27:25.459752+0000","last_became_active":"2024-08-17T02:27:25.452935+0000","last_became_peered":"2024-08-17T02:27:25.452935+0000","last_unstale":"2024-08-17T02:27:25.459752+0000","last_undegraded":"2024-08-17T02:27:25.459752+0000","last_fullsized":"2024-08-17T02:27:25.459752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455153+0000","last_change":"2024-08-17T02:27:25.446924+0000","last_active":"2024-08-17T02:27:25.455153+0000","last_peered":"2024-08-17T02:27:25.455153+0000","last_clean":"2024-08-17T02:27:25.455153+0000","last_became_active":"2024-08-17T02:27:25.446221+0000","last_became_peered":"2024-08-17T02:27:25.446221+0000","last_unstale":"2024-08-17T02:27:25.455153+0000","last_undegraded":"2024-08-17T02:27:25.455153+0000","last_fullsized":"2024-08-17T02:27:25.455153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470821+0000","last_change":"2024-08-17T02:27:25.470009+0000","last_active":"2024-08-17T02:27:25.470821+0000","last_peered":"2024-08-17T02:27:25.470821+0000","last_clean":"2024-08-17T02:27:25.470821+0000","last_became_active":"2024-08-17T02:27:25.469648+0000","last_became_peered":"2024-08-17T02:27:25.469648+0000","last_unstale":"2024-08-17T02:27:25.470821+0000","last_undegraded":"2024-08-17T02:27:25.470821+0000","last_fullsized":"2024-08-17T02:27:25.470821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454890+0000","last_change":"2024-08-17T02:27:25.449603+0000","last_active":"2024-08-17T02:27:25.454890+0000","last_peered":"2024-08-17T02:27:25.454890+0000","last_clean":"2024-08-17T02:27:25.454890+0000","last_became_active":"2024-08-17T02:27:25.449260+0000","last_became_peered":"2024-08-17T02:27:25.449260+0000","last_unstale":"2024-08-17T02:27:25.454890+0000","last_undegraded":"2024-08-17T02:27:25.454890+0000","last_fullsized":"2024-08-17T02:27:25.454890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456632+0000","last_change":"2024-08-17T02:27:25.452008+0000","last_active":"2024-08-17T02:27:25.456632+0000","last_peered":"2024-08-17T02:27:25.456632+0000","last_clean":"2024-08-17T02:27:25.456632+0000","last_became_active":"2024-08-17T02:27:25.451745+0000","last_became_peered":"2024-08-17T02:27:25.451745+0000","last_unstale":"2024-08-17T02:27:25.456632+0000","last_undegraded":"2024-08-17T02:27:25.456632+0000","last_fullsized":"2024-08-17T02:27:25.456632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462102+0000","last_change":"2024-08-17T02:27:25.456866+0000","last_active":"2024-08-17T02:27:25.462102+0000","last_peered":"2024-08-17T02:27:25.462102+0000","last_clean":"2024-08-17T02:27:25.462102+0000","last_became_active":"2024-08-17T02:27:25.456558+0000","last_became_peered":"2024-08-17T02:27:25.456558+0000","last_unstale":"2024-08-17T02:27:25.462102+0000","last_undegraded":"2024-08-17T02:27:25.462102+0000","last_fullsized":"2024-08-17T02:27:25.462102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466556+0000","last_change":"2024-08-17T02:27:25.455754+0000","last_active":"2024-08-17T02:27:25.466556+0000","last_peered":"2024-08-17T02:27:25.466556+0000","last_clean":"2024-08-17T02:27:25.466556+0000","last_became_active":"2024-08-17T02:27:25.449947+0000","last_became_peered":"2024-08-17T02:27:25.449947+0000","last_unstale":"2024-08-17T02:27:25.466556+0000","last_undegraded":"2024-08-17T02:27:25.466556+0000","last_fullsized":"2024-08-17T02:27:25.466556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460668+0000","last_change":"2024-08-17T02:27:25.451824+0000","last_active":"2024-08-17T02:27:25.460668+0000","last_peered":"2024-08-17T02:27:25.460668+0000","last_clean":"2024-08-17T02:27:25.460668+0000","last_became_active":"2024-08-17T02:27:25.451484+0000","last_became_peered":"2024-08-17T02:27:25.451484+0000","last_unstale":"2024-08-17T02:27:25.460668+0000","last_undegraded":"2024-08-17T02:27:25.460668+0000","last_fullsized":"2024-08-17T02:27:25.460668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438873+0000","last_change":"2024-08-17T02:27:25.437579+0000","last_active":"2024-08-17T02:27:25.438873+0000","last_peered":"2024-08-17T02:27:25.438873+0000","last_clean":"2024-08-17T02:27:25.438873+0000","last_became_active":"2024-08-17T02:27:25.437293+0000","last_became_peered":"2024-08-17T02:27:25.437293+0000","last_unstale":"2024-08-17T02:27:25.438873+0000","last_undegraded":"2024-08-17T02:27:25.438873+0000","last_fullsized":"2024-08-17T02:27:25.438873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451016+0000","last_change":"2024-08-17T02:27:25.439072+0000","last_active":"2024-08-17T02:27:25.451016+0000","last_peered":"2024-08-17T02:27:25.451016+0000","last_clean":"2024-08-17T02:27:25.451016+0000","last_became_active":"2024-08-17T02:27:25.438775+0000","last_became_peered":"2024-08-17T02:27:25.438775+0000","last_unstale":"2024-08-17T02:27:25.451016+0000","last_undegraded":"2024-08-17T02:27:25.451016+0000","last_fullsized":"2024-08-17T02:27:25.451016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441975+0000","last_change":"2024-08-17T02:27:25.435276+0000","last_active":"2024-08-17T02:27:25.441975+0000","last_peered":"2024-08-17T02:27:25.441975+0000","last_clean":"2024-08-17T02:27:25.441975+0000","last_became_active":"2024-08-17T02:27:25.433425+0000","last_became_peered":"2024-08-17T02:27:25.433425+0000","last_unstale":"2024-08-17T02:27:25.441975+0000","last_undegraded":"2024-08-17T02:27:25.441975+0000","last_fullsized":"2024-08-17T02:27:25.441975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461122+0000","last_change":"2024-08-17T02:27:25.441556+0000","last_active":"2024-08-17T02:27:25.461122+0000","last_peered":"2024-08-17T02:27:25.461122+0000","last_clean":"2024-08-17T02:27:25.461122+0000","last_became_active":"2024-08-17T02:27:25.441313+0000","last_became_peered":"2024-08-17T02:27:25.441313+0000","last_unstale":"2024-08-17T02:27:25.461122+0000","last_undegraded":"2024-08-17T02:27:25.461122+0000","last_fullsized":"2024-08-17T02:27:25.461122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454910+0000","last_change":"2024-08-17T02:27:25.450943+0000","last_active":"2024-08-17T02:27:25.454910+0000","last_peered":"2024-08-17T02:27:25.454910+0000","last_clean":"2024-08-17T02:27:25.454910+0000","last_became_active":"2024-08-17T02:27:25.449195+0000","last_became_peered":"2024-08-17T02:27:25.449195+0000","last_unstale":"2024-08-17T02:27:25.454910+0000","last_undegraded":"2024-08-17T02:27:25.454910+0000","last_fullsized":"2024-08-17T02:27:25.454910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439145+0000","last_change":"2024-08-17T02:27:25.436204+0000","last_active":"2024-08-17T02:27:25.439145+0000","last_peered":"2024-08-17T02:27:25.439145+0000","last_clean":"2024-08-17T02:27:25.439145+0000","last_became_active":"2024-08-17T02:27:25.435925+0000","last_became_peered":"2024-08-17T02:27:25.435925+0000","last_unstale":"2024-08-17T02:27:25.439145+0000","last_undegraded":"2024-08-17T02:27:25.439145+0000","last_fullsized":"2024-08-17T02:27:25.439145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456664+0000","last_change":"2024-08-17T02:27:25.452597+0000","last_active":"2024-08-17T02:27:25.456664+0000","last_peered":"2024-08-17T02:27:25.456664+0000","last_clean":"2024-08-17T02:27:25.456664+0000","last_became_active":"2024-08-17T02:27:25.452396+0000","last_became_peered":"2024-08-17T02:27:25.452396+0000","last_unstale":"2024-08-17T02:27:25.456664+0000","last_undegraded":"2024-08-17T02:27:25.456664+0000","last_fullsized":"2024-08-17T02:27:25.456664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451355+0000","last_change":"2024-08-17T02:27:25.448186+0000","last_active":"2024-08-17T02:27:25.451355+0000","last_peered":"2024-08-17T02:27:25.451355+0000","last_clean":"2024-08-17T02:27:25.451355+0000","last_became_active":"2024-08-17T02:27:25.446348+0000","last_became_peered":"2024-08-17T02:27:25.446348+0000","last_unstale":"2024-08-17T02:27:25.451355+0000","last_undegraded":"2024-08-17T02:27:25.451355+0000","last_fullsized":"2024-08-17T02:27:25.451355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446526+0000","last_change":"2024-08-17T02:27:25.440779+0000","last_active":"2024-08-17T02:27:25.446526+0000","last_peered":"2024-08-17T02:27:25.446526+0000","last_clean":"2024-08-17T02:27:25.446526+0000","last_became_active":"2024-08-17T02:27:25.440337+0000","last_became_peered":"2024-08-17T02:27:25.440337+0000","last_unstale":"2024-08-17T02:27:25.446526+0000","last_undegraded":"2024-08-17T02:27:25.446526+0000","last_fullsized":"2024-08-17T02:27:25.446526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456529+0000","last_change":"2024-08-17T02:27:25.449909+0000","last_active":"2024-08-17T02:27:25.456529+0000","last_peered":"2024-08-17T02:27:25.456529+0000","last_clean":"2024-08-17T02:27:25.456529+0000","last_became_active":"2024-08-17T02:27:25.449657+0000","last_became_peered":"2024-08-17T02:27:25.449657+0000","last_unstale":"2024-08-17T02:27:25.456529+0000","last_undegraded":"2024-08-17T02:27:25.456529+0000","last_fullsized":"2024-08-17T02:27:25.456529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451092+0000","last_change":"2024-08-17T02:27:25.439755+0000","last_active":"2024-08-17T02:27:25.451092+0000","last_peered":"2024-08-17T02:27:25.451092+0000","last_clean":"2024-08-17T02:27:25.451092+0000","last_became_active":"2024-08-17T02:27:25.439512+0000","last_became_peered":"2024-08-17T02:27:25.439512+0000","last_unstale":"2024-08-17T02:27:25.451092+0000","last_undegraded":"2024-08-17T02:27:25.451092+0000","last_fullsized":"2024-08-17T02:27:25.451092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451164+0000","last_change":"2024-08-17T02:27:25.445422+0000","last_active":"2024-08-17T02:27:25.451164+0000","last_peered":"2024-08-17T02:27:25.451164+0000","last_clean":"2024-08-17T02:27:25.451164+0000","last_became_active":"2024-08-17T02:27:25.445153+0000","last_became_peered":"2024-08-17T02:27:25.445153+0000","last_unstale":"2024-08-17T02:27:25.451164+0000","last_undegraded":"2024-08-17T02:27:25.451164+0000","last_fullsized":"2024-08-17T02:27:25.451164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450548+0000","last_change":"2024-08-17T02:27:25.445499+0000","last_active":"2024-08-17T02:27:25.450548+0000","last_peered":"2024-08-17T02:27:25.450548+0000","last_clean":"2024-08-17T02:27:25.450548+0000","last_became_active":"2024-08-17T02:27:25.445127+0000","last_became_peered":"2024-08-17T02:27:25.445127+0000","last_unstale":"2024-08-17T02:27:25.450548+0000","last_undegraded":"2024-08-17T02:27:25.450548+0000","last_fullsized":"2024-08-17T02:27:25.450548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466499+0000","last_change":"2024-08-17T02:27:25.460811+0000","last_active":"2024-08-17T02:27:25.466499+0000","last_peered":"2024-08-17T02:27:25.466499+0000","last_clean":"2024-08-17T02:27:25.466499+0000","last_became_active":"2024-08-17T02:27:25.460513+0000","last_became_peered":"2024-08-17T02:27:25.460513+0000","last_unstale":"2024-08-17T02:27:25.466499+0000","last_undegraded":"2024-08-17T02:27:25.466499+0000","last_fullsized":"2024-08-17T02:27:25.466499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468295+0000","last_change":"2024-08-17T02:27:25.466496+0000","last_active":"2024-08-17T02:27:25.468295+0000","last_peered":"2024-08-17T02:27:25.468295+0000","last_clean":"2024-08-17T02:27:25.468295+0000","last_became_active":"2024-08-17T02:27:25.466240+0000","last_became_peered":"2024-08-17T02:27:25.466240+0000","last_unstale":"2024-08-17T02:27:25.468295+0000","last_undegraded":"2024-08-17T02:27:25.468295+0000","last_fullsized":"2024-08-17T02:27:25.468295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467606+0000","last_change":"2024-08-17T02:27:25.461454+0000","last_active":"2024-08-17T02:27:25.467606+0000","last_peered":"2024-08-17T02:27:25.467606+0000","last_clean":"2024-08-17T02:27:25.467606+0000","last_became_active":"2024-08-17T02:27:25.460585+0000","last_became_peered":"2024-08-17T02:27:25.460585+0000","last_unstale":"2024-08-17T02:27:25.467606+0000","last_undegraded":"2024-08-17T02:27:25.467606+0000","last_fullsized":"2024-08-17T02:27:25.467606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.452006+0000","last_change":"2024-08-17T02:27:25.440879+0000","last_active":"2024-08-17T02:27:25.452006+0000","last_peered":"2024-08-17T02:27:25.452006+0000","last_clean":"2024-08-17T02:27:25.452006+0000","last_became_active":"2024-08-17T02:27:25.440638+0000","last_became_peered":"2024-08-17T02:27:25.440638+0000","last_unstale":"2024-08-17T02:27:25.452006+0000","last_undegraded":"2024-08-17T02:27:25.452006+0000","last_fullsized":"2024-08-17T02:27:25.452006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465682+0000","last_change":"2024-08-17T02:27:25.463971+0000","last_active":"2024-08-17T02:27:25.465682+0000","last_peered":"2024-08-17T02:27:25.465682+0000","last_clean":"2024-08-17T02:27:25.465682+0000","last_became_active":"2024-08-17T02:27:25.463657+0000","last_became_peered":"2024-08-17T02:27:25.463657+0000","last_unstale":"2024-08-17T02:27:25.465682+0000","last_undegraded":"2024-08-17T02:27:25.465682+0000","last_fullsized":"2024-08-17T02:27:25.465682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465530+0000","last_change":"2024-08-17T02:27:25.450808+0000","last_active":"2024-08-17T02:27:25.465530+0000","last_peered":"2024-08-17T02:27:25.465530+0000","last_clean":"2024-08-17T02:27:25.465530+0000","last_became_active":"2024-08-17T02:27:25.450474+0000","last_became_peered":"2024-08-17T02:27:25.450474+0000","last_unstale":"2024-08-17T02:27:25.465530+0000","last_undegraded":"2024-08-17T02:27:25.465530+0000","last_fullsized":"2024-08-17T02:27:25.465530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464102+0000","last_change":"2024-08-17T02:27:25.462561+0000","last_active":"2024-08-17T02:27:25.464102+0000","last_peered":"2024-08-17T02:27:25.464102+0000","last_clean":"2024-08-17T02:27:25.464102+0000","last_became_active":"2024-08-17T02:27:25.462314+0000","last_became_peered":"2024-08-17T02:27:25.462314+0000","last_unstale":"2024-08-17T02:27:25.464102+0000","last_undegraded":"2024-08-17T02:27:25.464102+0000","last_fullsized":"2024-08-17T02:27:25.464102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:55.384786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468210+0000","last_change":"2024-08-17T02:27:25.465776+0000","last_active":"2024-08-17T02:27:25.468210+0000","last_peered":"2024-08-17T02:27:25.468210+0000","last_clean":"2024-08-17T02:27:25.468210+0000","last_became_active":"2024-08-17T02:27:25.465517+0000","last_became_peered":"2024-08-17T02:27:25.465517+0000","last_unstale":"2024-08-17T02:27:25.468210+0000","last_undegraded":"2024-08-17T02:27:25.468210+0000","last_fullsized":"2024-08-17T02:27:25.468210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446395+0000","last_change":"2024-08-17T02:27:25.436230+0000","last_active":"2024-08-17T02:27:25.446395+0000","last_peered":"2024-08-17T02:27:25.446395+0000","last_clean":"2024-08-17T02:27:25.446395+0000","last_became_active":"2024-08-17T02:27:25.435981+0000","last_became_peered":"2024-08-17T02:27:25.435981+0000","last_unstale":"2024-08-17T02:27:25.446395+0000","last_undegraded":"2024-08-17T02:27:25.446395+0000","last_fullsized":"2024-08-17T02:27:25.446395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455807+0000","last_change":"2024-08-17T02:27:25.453066+0000","last_active":"2024-08-17T02:27:25.455807+0000","last_peered":"2024-08-17T02:27:25.455807+0000","last_clean":"2024-08-17T02:27:25.455807+0000","last_became_active":"2024-08-17T02:27:25.452821+0000","last_became_peered":"2024-08-17T02:27:25.452821+0000","last_unstale":"2024-08-17T02:27:25.455807+0000","last_undegraded":"2024-08-17T02:27:25.455807+0000","last_fullsized":"2024-08-17T02:27:25.455807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:07:02.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441899+0000","last_change":"2024-08-17T02:27:25.430552+0000","last_active":"2024-08-17T02:27:25.441899+0000","last_peered":"2024-08-17T02:27:25.441899+0000","last_clean":"2024-08-17T02:27:25.441899+0000","last_became_active":"2024-08-17T02:27:25.429351+0000","last_became_peered":"2024-08-17T02:27:25.429351+0000","last_unstale":"2024-08-17T02:27:25.441899+0000","last_undegraded":"2024-08-17T02:27:25.441899+0000","last_fullsized":"2024-08-17T02:27:25.441899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:57.515905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470407+0000","last_change":"2024-08-17T02:27:24.450643+0000","last_active":"2024-08-17T02:27:25.470407+0000","last_peered":"2024-08-17T02:27:25.470407+0000","last_clean":"2024-08-17T02:27:25.470407+0000","last_became_active":"2024-08-17T02:27:24.450201+0000","last_became_peered":"2024-08-17T02:27:24.450201+0000","last_unstale":"2024-08-17T02:27:25.470407+0000","last_undegraded":"2024-08-17T02:27:25.470407+0000","last_fullsized":"2024-08-17T02:27:25.470407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451185+0000","last_change":"2024-08-17T02:27:25.445553+0000","last_active":"2024-08-17T02:27:25.451185+0000","last_peered":"2024-08-17T02:27:25.451185+0000","last_clean":"2024-08-17T02:27:25.451185+0000","last_became_active":"2024-08-17T02:27:25.445275+0000","last_became_peered":"2024-08-17T02:27:25.445275+0000","last_unstale":"2024-08-17T02:27:25.451185+0000","last_undegraded":"2024-08-17T02:27:25.451185+0000","last_fullsized":"2024-08-17T02:27:25.451185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461254+0000","last_change":"2024-08-17T02:27:24.439165+0000","last_active":"2024-08-17T02:27:25.461254+0000","last_peered":"2024-08-17T02:27:25.461254+0000","last_clean":"2024-08-17T02:27:25.461254+0000","last_became_active":"2024-08-17T02:27:24.437397+0000","last_became_peered":"2024-08-17T02:27:24.437397+0000","last_unstale":"2024-08-17T02:27:25.461254+0000","last_undegraded":"2024-08-17T02:27:25.461254+0000","last_fullsized":"2024-08-17T02:27:25.461254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.429962+0000","last_change":"2024-08-17T02:27:24.445238+0000","last_active":"2024-08-17T02:27:25.429962+0000","last_peered":"2024-08-17T02:27:25.429962+0000","last_clean":"2024-08-17T02:27:25.429962+0000","last_became_active":"2024-08-17T02:27:24.444156+0000","last_became_peered":"2024-08-17T02:27:24.444156+0000","last_unstale":"2024-08-17T02:27:25.429962+0000","last_undegraded":"2024-08-17T02:27:25.429962+0000","last_fullsized":"2024-08-17T02:27:25.429962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466566+0000","last_change":"2024-08-17T02:27:25.456302+0000","last_active":"2024-08-17T02:27:25.466566+0000","last_peered":"2024-08-17T02:27:25.466566+0000","last_clean":"2024-08-17T02:27:25.466566+0000","last_became_active":"2024-08-17T02:27:25.456006+0000","last_became_peered":"2024-08-17T02:27:25.456006+0000","last_unstale":"2024-08-17T02:27:25.466566+0000","last_undegraded":"2024-08-17T02:27:25.466566+0000","last_fullsized":"2024-08-17T02:27:25.466566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.430567+0000","last_change":"2024-08-17T02:27:24.442260+0000","last_active":"2024-08-17T02:27:25.430567+0000","last_peered":"2024-08-17T02:27:25.430567+0000","last_clean":"2024-08-17T02:27:25.430567+0000","last_became_active":"2024-08-17T02:27:24.440158+0000","last_became_peered":"2024-08-17T02:27:24.440158+0000","last_unstale":"2024-08-17T02:27:25.430567+0000","last_undegraded":"2024-08-17T02:27:25.430567+0000","last_fullsized":"2024-08-17T02:27:25.430567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.442431+0000","last_change":"2024-08-17T02:27:25.439235+0000","last_active":"2024-08-17T02:27:25.442431+0000","last_peered":"2024-08-17T02:27:25.442431+0000","last_clean":"2024-08-17T02:27:25.442431+0000","last_became_active":"2024-08-17T02:27:25.438932+0000","last_became_peered":"2024-08-17T02:27:25.438932+0000","last_unstale":"2024-08-17T02:27:25.442431+0000","last_undegraded":"2024-08-17T02:27:25.442431+0000","last_fullsized":"2024-08-17T02:27:25.442431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.426017+0000","last_change":"2024-08-17T02:27:24.439888+0000","last_active":"2024-08-17T02:27:25.426017+0000","last_peered":"2024-08-17T02:27:25.426017+0000","last_clean":"2024-08-17T02:27:25.426017+0000","last_became_active":"2024-08-17T02:27:24.439256+0000","last_became_peered":"2024-08-17T02:27:24.439256+0000","last_unstale":"2024-08-17T02:27:25.426017+0000","last_undegraded":"2024-08-17T02:27:25.426017+0000","last_fullsized":"2024-08-17T02:27:25.426017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450765+0000","last_change":"2024-08-17T02:27:25.445654+0000","last_active":"2024-08-17T02:27:25.450765+0000","last_peered":"2024-08-17T02:27:25.450765+0000","last_clean":"2024-08-17T02:27:25.450765+0000","last_became_active":"2024-08-17T02:27:25.445315+0000","last_became_peered":"2024-08-17T02:27:25.445315+0000","last_unstale":"2024-08-17T02:27:25.450765+0000","last_undegraded":"2024-08-17T02:27:25.450765+0000","last_fullsized":"2024-08-17T02:27:25.450765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431851+0000","last_change":"2024-08-17T02:27:24.439678+0000","last_active":"2024-08-17T02:27:25.431851+0000","last_peered":"2024-08-17T02:27:25.431851+0000","last_clean":"2024-08-17T02:27:25.431851+0000","last_became_active":"2024-08-17T02:27:24.438827+0000","last_became_peered":"2024-08-17T02:27:24.438827+0000","last_unstale":"2024-08-17T02:27:25.431851+0000","last_undegraded":"2024-08-17T02:27:25.431851+0000","last_fullsized":"2024-08-17T02:27:25.431851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453338+0000","last_change":"2024-08-17T02:27:25.446818+0000","last_active":"2024-08-17T02:27:25.453338+0000","last_peered":"2024-08-17T02:27:25.453338+0000","last_clean":"2024-08-17T02:27:25.453338+0000","last_became_active":"2024-08-17T02:27:25.446160+0000","last_became_peered":"2024-08-17T02:27:25.446160+0000","last_unstale":"2024-08-17T02:27:25.453338+0000","last_undegraded":"2024-08-17T02:27:25.453338+0000","last_fullsized":"2024-08-17T02:27:25.453338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461740+0000","last_change":"2024-08-17T02:27:24.444574+0000","last_active":"2024-08-17T02:27:25.461740+0000","last_peered":"2024-08-17T02:27:25.461740+0000","last_clean":"2024-08-17T02:27:25.461740+0000","last_became_active":"2024-08-17T02:27:24.444333+0000","last_became_peered":"2024-08-17T02:27:24.444333+0000","last_unstale":"2024-08-17T02:27:25.461740+0000","last_undegraded":"2024-08-17T02:27:25.461740+0000","last_fullsized":"2024-08-17T02:27:25.461740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457512+0000","last_change":"2024-08-17T02:27:25.444360+0000","last_active":"2024-08-17T02:27:25.457512+0000","last_peered":"2024-08-17T02:27:25.457512+0000","last_clean":"2024-08-17T02:27:25.457512+0000","last_became_active":"2024-08-17T02:27:25.444106+0000","last_became_peered":"2024-08-17T02:27:25.444106+0000","last_unstale":"2024-08-17T02:27:25.457512+0000","last_undegraded":"2024-08-17T02:27:25.457512+0000","last_fullsized":"2024-08-17T02:27:25.457512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:43.203136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.472906+0000","last_change":"2024-08-17T02:27:24.445437+0000","last_active":"2024-08-17T02:27:25.472906+0000","last_peered":"2024-08-17T02:27:25.472906+0000","last_clean":"2024-08-17T02:27:25.472906+0000","last_became_active":"2024-08-17T02:27:24.445008+0000","last_became_peered":"2024-08-17T02:27:24.445008+0000","last_unstale":"2024-08-17T02:27:25.472906+0000","last_undegraded":"2024-08-17T02:27:25.472906+0000","last_fullsized":"2024-08-17T02:27:25.472906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462054+0000","last_change":"2024-08-17T02:27:25.456825+0000","last_active":"2024-08-17T02:27:25.462054+0000","last_peered":"2024-08-17T02:27:25.462054+0000","last_clean":"2024-08-17T02:27:25.462054+0000","last_became_active":"2024-08-17T02:27:25.456323+0000","last_became_peered":"2024-08-17T02:27:25.456323+0000","last_unstale":"2024-08-17T02:27:25.462054+0000","last_undegraded":"2024-08-17T02:27:25.462054+0000","last_fullsized":"2024-08-17T02:27:25.462054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464743+0000","last_change":"2024-08-17T02:27:24.438473+0000","last_active":"2024-08-17T02:27:25.464743+0000","last_peered":"2024-08-17T02:27:25.464743+0000","last_clean":"2024-08-17T02:27:25.464743+0000","last_became_active":"2024-08-17T02:27:24.438205+0000","last_became_peered":"2024-08-17T02:27:24.438205+0000","last_unstale":"2024-08-17T02:27:25.464743+0000","last_undegraded":"2024-08-17T02:27:25.464743+0000","last_fullsized":"2024-08-17T02:27:25.464743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:56.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454929+0000","last_change":"2024-08-17T02:27:25.451195+0000","last_active":"2024-08-17T02:27:25.454929+0000","last_peered":"2024-08-17T02:27:25.454929+0000","last_clean":"2024-08-17T02:27:25.454929+0000","last_became_active":"2024-08-17T02:27:25.444332+0000","last_became_peered":"2024-08-17T02:27:25.444332+0000","last_unstale":"2024-08-17T02:27:25.454929+0000","last_undegraded":"2024-08-17T02:27:25.454929+0000","last_fullsized":"2024-08-17T02:27:25.454929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431434+0000","last_change":"2024-08-17T02:27:24.444612+0000","last_active":"2024-08-17T02:27:25.431434+0000","last_peered":"2024-08-17T02:27:25.431434+0000","last_clean":"2024-08-17T02:27:25.431434+0000","last_became_active":"2024-08-17T02:27:24.444307+0000","last_became_peered":"2024-08-17T02:27:24.444307+0000","last_unstale":"2024-08-17T02:27:25.431434+0000","last_undegraded":"2024-08-17T02:27:25.431434+0000","last_fullsized":"2024-08-17T02:27:25.431434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462196+0000","last_change":"2024-08-17T02:27:25.458229+0000","last_active":"2024-08-17T02:27:25.462196+0000","last_peered":"2024-08-17T02:27:25.462196+0000","last_clean":"2024-08-17T02:27:25.462196+0000","last_became_active":"2024-08-17T02:27:25.457949+0000","last_became_peered":"2024-08-17T02:27:25.457949+0000","last_unstale":"2024-08-17T02:27:25.462196+0000","last_undegraded":"2024-08-17T02:27:25.462196+0000","last_fullsized":"2024-08-17T02:27:25.462196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425557+0000","last_change":"2024-08-17T02:27:24.435541+0000","last_active":"2024-08-17T02:27:25.425557+0000","last_peered":"2024-08-17T02:27:25.425557+0000","last_clean":"2024-08-17T02:27:25.425557+0000","last_became_active":"2024-08-17T02:27:24.435267+0000","last_became_peered":"2024-08-17T02:27:24.435267+0000","last_unstale":"2024-08-17T02:27:25.425557+0000","last_undegraded":"2024-08-17T02:27:25.425557+0000","last_fullsized":"2024-08-17T02:27:25.425557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453321+0000","last_change":"2024-08-17T02:27:25.442847+0000","last_active":"2024-08-17T02:27:25.453321+0000","last_peered":"2024-08-17T02:27:25.453321+0000","last_clean":"2024-08-17T02:27:25.453321+0000","last_became_active":"2024-08-17T02:27:25.442470+0000","last_became_peered":"2024-08-17T02:27:25.442470+0000","last_unstale":"2024-08-17T02:27:25.453321+0000","last_undegraded":"2024-08-17T02:27:25.453321+0000","last_fullsized":"2024-08-17T02:27:25.453321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:50.390710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464153+0000","last_change":"2024-08-17T02:27:24.437545+0000","last_active":"2024-08-17T02:27:25.464153+0000","last_peered":"2024-08-17T02:27:25.464153+0000","last_clean":"2024-08-17T02:27:25.464153+0000","last_became_active":"2024-08-17T02:27:24.437177+0000","last_became_peered":"2024-08-17T02:27:24.437177+0000","last_unstale":"2024-08-17T02:27:25.464153+0000","last_undegraded":"2024-08-17T02:27:25.464153+0000","last_fullsized":"2024-08-17T02:27:25.464153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462291+0000","last_change":"2024-08-17T02:27:25.458884+0000","last_active":"2024-08-17T02:27:25.462291+0000","last_peered":"2024-08-17T02:27:25.462291+0000","last_clean":"2024-08-17T02:27:25.462291+0000","last_became_active":"2024-08-17T02:27:25.458541+0000","last_became_peered":"2024-08-17T02:27:25.458541+0000","last_unstale":"2024-08-17T02:27:25.462291+0000","last_undegraded":"2024-08-17T02:27:25.462291+0000","last_fullsized":"2024-08-17T02:27:25.462291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461445+0000","last_change":"2024-08-17T02:27:24.438345+0000","last_active":"2024-08-17T02:27:25.461445+0000","last_peered":"2024-08-17T02:27:25.461445+0000","last_clean":"2024-08-17T02:27:25.461445+0000","last_became_active":"2024-08-17T02:27:24.438014+0000","last_became_peered":"2024-08-17T02:27:24.438014+0000","last_unstale":"2024-08-17T02:27:25.461445+0000","last_undegraded":"2024-08-17T02:27:25.461445+0000","last_fullsized":"2024-08-17T02:27:25.461445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:51.236659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460458+0000","last_change":"2024-08-17T02:27:25.451119+0000","last_active":"2024-08-17T02:27:25.460458+0000","last_peered":"2024-08-17T02:27:25.460458+0000","last_clean":"2024-08-17T02:27:25.460458+0000","last_became_active":"2024-08-17T02:27:25.450850+0000","last_became_peered":"2024-08-17T02:27:25.450850+0000","last_unstale":"2024-08-17T02:27:25.460458+0000","last_undegraded":"2024-08-17T02:27:25.460458+0000","last_fullsized":"2024-08-17T02:27:25.460458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466776+0000","last_change":"2024-08-17T02:27:24.448256+0000","last_active":"2024-08-17T02:27:25.466776+0000","last_peered":"2024-08-17T02:27:25.466776+0000","last_clean":"2024-08-17T02:27:25.466776+0000","last_became_active":"2024-08-17T02:27:24.447922+0000","last_became_peered":"2024-08-17T02:27:24.447922+0000","last_unstale":"2024-08-17T02:27:25.466776+0000","last_undegraded":"2024-08-17T02:27:25.466776+0000","last_fullsized":"2024-08-17T02:27:25.466776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462323+0000","last_change":"2024-08-17T02:27:25.458937+0000","last_active":"2024-08-17T02:27:25.462323+0000","last_peered":"2024-08-17T02:27:25.462323+0000","last_clean":"2024-08-17T02:27:25.462323+0000","last_became_active":"2024-08-17T02:27:25.458689+0000","last_became_peered":"2024-08-17T02:27:25.458689+0000","last_unstale":"2024-08-17T02:27:25.462323+0000","last_undegraded":"2024-08-17T02:27:25.462323+0000","last_fullsized":"2024-08-17T02:27:25.462323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461606+0000","last_change":"2024-08-17T02:27:24.436502+0000","last_active":"2024-08-17T02:27:25.461606+0000","last_peered":"2024-08-17T02:27:25.461606+0000","last_clean":"2024-08-17T02:27:25.461606+0000","last_became_active":"2024-08-17T02:27:24.435360+0000","last_became_peered":"2024-08-17T02:27:24.435360+0000","last_unstale":"2024-08-17T02:27:25.461606+0000","last_undegraded":"2024-08-17T02:27:25.461606+0000","last_fullsized":"2024-08-17T02:27:25.461606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467392+0000","last_change":"2024-08-17T02:27:25.465732+0000","last_active":"2024-08-17T02:27:25.467392+0000","last_peered":"2024-08-17T02:27:25.467392+0000","last_clean":"2024-08-17T02:27:25.467392+0000","last_became_active":"2024-08-17T02:27:25.465477+0000","last_became_peered":"2024-08-17T02:27:25.465477+0000","last_unstale":"2024-08-17T02:27:25.467392+0000","last_undegraded":"2024-08-17T02:27:25.467392+0000","last_fullsized":"2024-08-17T02:27:25.467392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.436763+0000","last_change":"2024-08-17T02:27:24.447436+0000","last_active":"2024-08-17T02:27:25.436763+0000","last_peered":"2024-08-17T02:27:25.436763+0000","last_clean":"2024-08-17T02:27:25.436763+0000","last_became_active":"2024-08-17T02:27:24.446567+0000","last_became_peered":"2024-08-17T02:27:24.446567+0000","last_unstale":"2024-08-17T02:27:25.436763+0000","last_undegraded":"2024-08-17T02:27:25.436763+0000","last_fullsized":"2024-08-17T02:27:25.436763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461787+0000","last_change":"2024-08-17T02:27:25.453401+0000","last_active":"2024-08-17T02:27:25.461787+0000","last_peered":"2024-08-17T02:27:25.461787+0000","last_clean":"2024-08-17T02:27:25.461787+0000","last_became_active":"2024-08-17T02:27:25.453012+0000","last_became_peered":"2024-08-17T02:27:25.453012+0000","last_unstale":"2024-08-17T02:27:25.461787+0000","last_undegraded":"2024-08-17T02:27:25.461787+0000","last_fullsized":"2024-08-17T02:27:25.461787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434221+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:27:25.434221+0000","last_peered":"2024-08-17T02:27:25.434221+0000","last_clean":"2024-08-17T02:27:25.434221+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:27:25.434221+0000","last_undegraded":"2024-08-17T02:27:25.434221+0000","last_fullsized":"2024-08-17T02:27:25.434221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.428317+0000","last_change":"2024-08-17T02:27:24.434655+0000","last_active":"2024-08-17T02:27:25.428317+0000","last_peered":"2024-08-17T02:27:25.428317+0000","last_clean":"2024-08-17T02:27:25.428317+0000","last_became_active":"2024-08-17T02:27:24.434310+0000","last_became_peered":"2024-08-17T02:27:24.434310+0000","last_unstale":"2024-08-17T02:27:25.428317+0000","last_undegraded":"2024-08-17T02:27:25.428317+0000","last_fullsized":"2024-08-17T02:27:25.428317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460185+0000","last_change":"2024-08-17T02:27:25.447580+0000","last_active":"2024-08-17T02:27:25.460185+0000","last_peered":"2024-08-17T02:27:25.460185+0000","last_clean":"2024-08-17T02:27:25.460185+0000","last_became_active":"2024-08-17T02:27:25.447348+0000","last_became_peered":"2024-08-17T02:27:25.447348+0000","last_unstale":"2024-08-17T02:27:25.460185+0000","last_undegraded":"2024-08-17T02:27:25.460185+0000","last_fullsized":"2024-08-17T02:27:25.460185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434137+0000","last_change":"2024-08-17T02:27:24.449181+0000","last_active":"2024-08-17T02:27:25.434137+0000","last_peered":"2024-08-17T02:27:25.434137+0000","last_clean":"2024-08-17T02:27:25.434137+0000","last_became_active":"2024-08-17T02:27:24.448621+0000","last_became_peered":"2024-08-17T02:27:24.448621+0000","last_unstale":"2024-08-17T02:27:25.434137+0000","last_undegraded":"2024-08-17T02:27:25.434137+0000","last_fullsized":"2024-08-17T02:27:25.434137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455088+0000","last_change":"2024-08-17T02:27:25.451371+0000","last_active":"2024-08-17T02:27:25.455088+0000","last_peered":"2024-08-17T02:27:25.455088+0000","last_clean":"2024-08-17T02:27:25.455088+0000","last_became_active":"2024-08-17T02:27:25.451050+0000","last_became_peered":"2024-08-17T02:27:25.451050+0000","last_unstale":"2024-08-17T02:27:25.455088+0000","last_undegraded":"2024-08-17T02:27:25.455088+0000","last_fullsized":"2024-08-17T02:27:25.455088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431977+0000","last_change":"2024-08-17T02:27:24.445048+0000","last_active":"2024-08-17T02:27:25.431977+0000","last_peered":"2024-08-17T02:27:25.431977+0000","last_clean":"2024-08-17T02:27:25.431977+0000","last_became_active":"2024-08-17T02:27:24.444710+0000","last_became_peered":"2024-08-17T02:27:24.444710+0000","last_unstale":"2024-08-17T02:27:25.431977+0000","last_undegraded":"2024-08-17T02:27:25.431977+0000","last_fullsized":"2024-08-17T02:27:25.431977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.444039+0000","last_change":"2024-08-17T02:27:25.440656+0000","last_active":"2024-08-17T02:27:25.444039+0000","last_peered":"2024-08-17T02:27:25.444039+0000","last_clean":"2024-08-17T02:27:25.444039+0000","last_became_active":"2024-08-17T02:27:25.440321+0000","last_became_peered":"2024-08-17T02:27:25.440321+0000","last_unstale":"2024-08-17T02:27:25.444039+0000","last_undegraded":"2024-08-17T02:27:25.444039+0000","last_fullsized":"2024-08-17T02:27:25.444039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431535+0000","last_change":"2024-08-17T02:27:24.437523+0000","last_active":"2024-08-17T02:27:25.431535+0000","last_peered":"2024-08-17T02:27:25.431535+0000","last_clean":"2024-08-17T02:27:25.431535+0000","last_became_active":"2024-08-17T02:27:24.437285+0000","last_became_peered":"2024-08-17T02:27:24.437285+0000","last_unstale":"2024-08-17T02:27:25.431535+0000","last_undegraded":"2024-08-17T02:27:25.431535+0000","last_fullsized":"2024-08-17T02:27:25.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459340+0000","last_change":"2024-08-17T02:27:25.449648+0000","last_active":"2024-08-17T02:27:25.459340+0000","last_peered":"2024-08-17T02:27:25.459340+0000","last_clean":"2024-08-17T02:27:25.459340+0000","last_became_active":"2024-08-17T02:27:25.447084+0000","last_became_peered":"2024-08-17T02:27:25.447084+0000","last_unstale":"2024-08-17T02:27:25.459340+0000","last_undegraded":"2024-08-17T02:27:25.459340+0000","last_fullsized":"2024-08-17T02:27:25.459340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425327+0000","last_change":"2024-08-17T02:27:24.437263+0000","last_active":"2024-08-17T02:27:25.425327+0000","last_peered":"2024-08-17T02:27:25.425327+0000","last_clean":"2024-08-17T02:27:25.425327+0000","last_became_active":"2024-08-17T02:27:24.436992+0000","last_became_peered":"2024-08-17T02:27:24.436992+0000","last_unstale":"2024-08-17T02:27:25.425327+0000","last_undegraded":"2024-08-17T02:27:25.425327+0000","last_fullsized":"2024-08-17T02:27:25.425327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468312+0000","last_change":"2024-08-17T02:27:25.466345+0000","last_active":"2024-08-17T02:27:25.468312+0000","last_peered":"2024-08-17T02:27:25.468312+0000","last_clean":"2024-08-17T02:27:25.468312+0000","last_became_active":"2024-08-17T02:27:25.466038+0000","last_became_peered":"2024-08-17T02:27:25.466038+0000","last_unstale":"2024-08-17T02:27:25.468312+0000","last_undegraded":"2024-08-17T02:27:25.468312+0000","last_fullsized":"2024-08-17T02:27:25.468312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438148+0000","last_change":"2024-08-17T02:27:24.449902+0000","last_active":"2024-08-17T02:27:25.438148+0000","last_peered":"2024-08-17T02:27:25.438148+0000","last_clean":"2024-08-17T02:27:25.438148+0000","last_became_active":"2024-08-17T02:27:24.449525+0000","last_became_peered":"2024-08-17T02:27:24.449525+0000","last_unstale":"2024-08-17T02:27:25.438148+0000","last_undegraded":"2024-08-17T02:27:25.438148+0000","last_fullsized":"2024-08-17T02:27:25.438148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.445653+0000","last_change":"2024-08-17T02:27:25.440529+0000","last_active":"2024-08-17T02:27:25.445653+0000","last_peered":"2024-08-17T02:27:25.445653+0000","last_clean":"2024-08-17T02:27:25.445653+0000","last_became_active":"2024-08-17T02:27:25.440188+0000","last_became_peered":"2024-08-17T02:27:25.440188+0000","last_unstale":"2024-08-17T02:27:25.445653+0000","last_undegraded":"2024-08-17T02:27:25.445653+0000","last_fullsized":"2024-08-17T02:27:25.445653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:26.541464+0000","last_change":"2024-08-17T02:27:24.435826+0000","last_active":"2024-08-17T02:27:26.541464+0000","last_peered":"2024-08-17T02:27:26.541464+0000","last_clean":"2024-08-17T02:27:26.541464+0000","last_became_active":"2024-08-17T02:27:24.435410+0000","last_became_peered":"2024-08-17T02:27:24.435410+0000","last_unstale":"2024-08-17T02:27:26.541464+0000","last_undegraded":"2024-08-17T02:27:26.541464+0000","last_fullsized":"2024-08-17T02:27:26.541464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460275+0000","last_change":"2024-08-17T02:27:25.456094+0000","last_active":"2024-08-17T02:27:25.460275+0000","last_peered":"2024-08-17T02:27:25.460275+0000","last_clean":"2024-08-17T02:27:25.460275+0000","last_became_active":"2024-08-17T02:27:25.454642+0000","last_became_peered":"2024-08-17T02:27:25.454642+0000","last_unstale":"2024-08-17T02:27:25.460275+0000","last_undegraded":"2024-08-17T02:27:25.460275+0000","last_fullsized":"2024-08-17T02:27:25.460275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464709+0000","last_change":"2024-08-17T02:27:24.452692+0000","last_active":"2024-08-17T02:27:25.464709+0000","last_peered":"2024-08-17T02:27:25.464709+0000","last_clean":"2024-08-17T02:27:25.464709+0000","last_became_active":"2024-08-17T02:27:24.452303+0000","last_became_peered":"2024-08-17T02:27:24.452303+0000","last_unstale":"2024-08-17T02:27:25.464709+0000","last_undegraded":"2024-08-17T02:27:25.464709+0000","last_fullsized":"2024-08-17T02:27:25.464709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457334+0000","last_change":"2024-08-17T02:27:25.450938+0000","last_active":"2024-08-17T02:27:25.457334+0000","last_peered":"2024-08-17T02:27:25.457334+0000","last_clean":"2024-08-17T02:27:25.457334+0000","last_became_active":"2024-08-17T02:27:25.442137+0000","last_became_peered":"2024-08-17T02:27:25.442137+0000","last_unstale":"2024-08-17T02:27:25.457334+0000","last_undegraded":"2024-08-17T02:27:25.457334+0000","last_fullsized":"2024-08-17T02:27:25.457334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434024+0000","last_change":"2024-08-17T02:27:24.447388+0000","last_active":"2024-08-17T02:27:25.434024+0000","last_peered":"2024-08-17T02:27:25.434024+0000","last_clean":"2024-08-17T02:27:25.434024+0000","last_became_active":"2024-08-17T02:27:24.447000+0000","last_became_peered":"2024-08-17T02:27:24.447000+0000","last_unstale":"2024-08-17T02:27:25.434024+0000","last_undegraded":"2024-08-17T02:27:25.434024+0000","last_fullsized":"2024-08-17T02:27:25.434024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.458050+0000","last_change":"2024-08-17T02:27:25.448457+0000","last_active":"2024-08-17T02:27:25.458050+0000","last_peered":"2024-08-17T02:27:25.458050+0000","last_clean":"2024-08-17T02:27:25.458050+0000","last_became_active":"2024-08-17T02:27:25.441769+0000","last_became_peered":"2024-08-17T02:27:25.441769+0000","last_unstale":"2024-08-17T02:27:25.458050+0000","last_undegraded":"2024-08-17T02:27:25.458050+0000","last_fullsized":"2024-08-17T02:27:25.458050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424675+0000","last_change":"2024-08-17T02:27:24.443925+0000","last_active":"2024-08-17T02:27:25.424675+0000","last_peered":"2024-08-17T02:27:25.424675+0000","last_clean":"2024-08-17T02:27:25.424675+0000","last_became_active":"2024-08-17T02:27:24.443608+0000","last_became_peered":"2024-08-17T02:27:24.443608+0000","last_unstale":"2024-08-17T02:27:25.424675+0000","last_undegraded":"2024-08-17T02:27:25.424675+0000","last_fullsized":"2024-08-17T02:27:25.424675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467733+0000","last_change":"2024-08-17T02:27:25.462228+0000","last_active":"2024-08-17T02:27:25.467733+0000","last_peered":"2024-08-17T02:27:25.467733+0000","last_clean":"2024-08-17T02:27:25.467733+0000","last_became_active":"2024-08-17T02:27:25.448840+0000","last_became_peered":"2024-08-17T02:27:25.448840+0000","last_unstale":"2024-08-17T02:27:25.467733+0000","last_undegraded":"2024-08-17T02:27:25.467733+0000","last_fullsized":"2024-08-17T02:27:25.467733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424091+0000","last_change":"2024-08-17T02:27:24.445306+0000","last_active":"2024-08-17T02:27:25.424091+0000","last_peered":"2024-08-17T02:27:25.424091+0000","last_clean":"2024-08-17T02:27:25.424091+0000","last_became_active":"2024-08-17T02:27:24.445012+0000","last_became_peered":"2024-08-17T02:27:24.445012+0000","last_unstale":"2024-08-17T02:27:25.424091+0000","last_undegraded":"2024-08-17T02:27:25.424091+0000","last_fullsized":"2024-08-17T02:27:25.424091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467550+0000","last_change":"2024-08-17T02:27:25.461234+0000","last_active":"2024-08-17T02:27:25.467550+0000","last_peered":"2024-08-17T02:27:25.467550+0000","last_clean":"2024-08-17T02:27:25.467550+0000","last_became_active":"2024-08-17T02:27:25.455041+0000","last_became_peered":"2024-08-17T02:27:25.455041+0000","last_unstale":"2024-08-17T02:27:25.467550+0000","last_undegraded":"2024-08-17T02:27:25.467550+0000","last_fullsized":"2024-08-17T02:27:25.467550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460395+0000","last_change":"2024-08-17T02:27:24.449904+0000","last_active":"2024-08-17T02:27:25.460395+0000","last_peered":"2024-08-17T02:27:25.460395+0000","last_clean":"2024-08-17T02:27:25.460395+0000","last_became_active":"2024-08-17T02:27:24.449492+0000","last_became_peered":"2024-08-17T02:27:24.449492+0000","last_unstale":"2024-08-17T02:27:25.460395+0000","last_undegraded":"2024-08-17T02:27:25.460395+0000","last_fullsized":"2024-08-17T02:27:25.460395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439656+0000","last_change":"2024-08-17T02:27:25.432877+0000","last_active":"2024-08-17T02:27:25.439656+0000","last_peered":"2024-08-17T02:27:25.439656+0000","last_clean":"2024-08-17T02:27:25.439656+0000","last_became_active":"2024-08-17T02:27:25.432587+0000","last_became_peered":"2024-08-17T02:27:25.432587+0000","last_unstale":"2024-08-17T02:27:25.439656+0000","last_undegraded":"2024-08-17T02:27:25.439656+0000","last_fullsized":"2024-08-17T02:27:25.439656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454969+0000","last_change":"2024-08-17T02:27:25.448549+0000","last_active":"2024-08-17T02:27:25.454969+0000","last_peered":"2024-08-17T02:27:25.454969+0000","last_clean":"2024-08-17T02:27:25.454969+0000","last_became_active":"2024-08-17T02:27:25.448001+0000","last_became_peered":"2024-08-17T02:27:25.448001+0000","last_unstale":"2024-08-17T02:27:25.454969+0000","last_undegraded":"2024-08-17T02:27:25.454969+0000","last_fullsized":"2024-08-17T02:27:25.454969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460460+0000","last_change":"2024-08-17T02:27:24.450947+0000","last_active":"2024-08-17T02:27:25.460460+0000","last_peered":"2024-08-17T02:27:25.460460+0000","last_clean":"2024-08-17T02:27:25.460460+0000","last_became_active":"2024-08-17T02:27:24.450649+0000","last_became_peered":"2024-08-17T02:27:24.450649+0000","last_unstale":"2024-08-17T02:27:25.460460+0000","last_undegraded":"2024-08-17T02:27:25.460460+0000","last_fullsized":"2024-08-17T02:27:25.460460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:33.132085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450998+0000","last_change":"2024-08-17T02:27:25.446668+0000","last_active":"2024-08-17T02:27:25.450998+0000","last_peered":"2024-08-17T02:27:25.450998+0000","last_clean":"2024-08-17T02:27:25.450998+0000","last_became_active":"2024-08-17T02:27:25.446347+0000","last_became_peered":"2024-08-17T02:27:25.446347+0000","last_unstale":"2024-08-17T02:27:25.450998+0000","last_undegraded":"2024-08-17T02:27:25.450998+0000","last_fullsized":"2024-08-17T02:27:25.450998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456596+0000","last_change":"2024-08-17T02:27:24.451135+0000","last_active":"2024-08-17T02:27:25.456596+0000","last_peered":"2024-08-17T02:27:25.456596+0000","last_clean":"2024-08-17T02:27:25.456596+0000","last_became_active":"2024-08-17T02:27:24.450804+0000","last_became_peered":"2024-08-17T02:27:24.450804+0000","last_unstale":"2024-08-17T02:27:25.456596+0000","last_undegraded":"2024-08-17T02:27:25.456596+0000","last_fullsized":"2024-08-17T02:27:25.456596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:51.057653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453406+0000","last_change":"2024-08-17T02:27:25.446961+0000","last_active":"2024-08-17T02:27:25.453406+0000","last_peered":"2024-08-17T02:27:25.453406+0000","last_clean":"2024-08-17T02:27:25.453406+0000","last_became_active":"2024-08-17T02:27:25.446547+0000","last_became_peered":"2024-08-17T02:27:25.446547+0000","last_unstale":"2024-08-17T02:27:25.453406+0000","last_undegraded":"2024-08-17T02:27:25.453406+0000","last_fullsized":"2024-08-17T02:27:25.453406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470520+0000","last_change":"2024-08-17T02:27:24.442678+0000","last_active":"2024-08-17T02:27:25.470520+0000","last_peered":"2024-08-17T02:27:25.470520+0000","last_clean":"2024-08-17T02:27:25.470520+0000","last_became_active":"2024-08-17T02:27:24.441192+0000","last_became_peered":"2024-08-17T02:27:24.441192+0000","last_unstale":"2024-08-17T02:27:25.470520+0000","last_undegraded":"2024-08-17T02:27:25.470520+0000","last_fullsized":"2024-08-17T02:27:25.470520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465734+0000","last_change":"2024-08-17T02:27:25.459255+0000","last_active":"2024-08-17T02:27:25.465734+0000","last_peered":"2024-08-17T02:27:25.465734+0000","last_clean":"2024-08-17T02:27:25.465734+0000","last_became_active":"2024-08-17T02:27:25.458944+0000","last_became_peered":"2024-08-17T02:27:25.458944+0000","last_unstale":"2024-08-17T02:27:25.465734+0000","last_undegraded":"2024-08-17T02:27:25.465734+0000","last_fullsized":"2024-08-17T02:27:25.465734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464782+0000","last_change":"2024-08-17T02:27:24.450686+0000","last_active":"2024-08-17T02:27:25.464782+0000","last_peered":"2024-08-17T02:27:25.464782+0000","last_clean":"2024-08-17T02:27:25.464782+0000","last_became_active":"2024-08-17T02:27:24.450410+0000","last_became_peered":"2024-08-17T02:27:24.450410+0000","last_unstale":"2024-08-17T02:27:25.464782+0000","last_undegraded":"2024-08-17T02:27:25.464782+0000","last_fullsized":"2024-08-17T02:27:25.464782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:34.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:34.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.867+0000 7fa53c600640 1 Processor -- start 2024-08-17T02:27:34.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.867+0000 7fa53c600640 1 -- start start 2024-08-17T02:27:34.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa53c600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 0x7fa53415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa53c600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5340add30 0x7fa534156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa53c600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53415b5e0 con 0x7fa5340ca050 2024-08-17T02:27:34.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa53c600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5340cb160 con 0x7fa5340add30 2024-08-17T02:27:34.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa53c600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b0d10 con 0x7fa5340ad960 2024-08-17T02:27:34.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa539c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 0x7fa53415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa539c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 0x7fa53415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:35638/0 (socket says 172.21.15.42:35638) 2024-08-17T02:27:34.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa539c00640 1 -- 172.21.15.42:0/1930289380 learned_addr learned my addr 172.21.15.42:0/1930289380 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:34.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.869+0000 7fa53a600640 1 --2- 172.21.15.42:0/1930289380 >> v2:172.21.15.62:3300/0 conn(0x7fa5340add30 0x7fa534156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.870+0000 7fa539c00640 1 -- 172.21.15.42:0/1930289380 >> v2:172.21.15.62:3300/0 conn(0x7fa5340add30 msgr2=0x7fa534156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:34.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.870+0000 7fa539c00640 1 --2- 172.21.15.42:0/1930289380 >> v2:172.21.15.62:3300/0 conn(0x7fa5340add30 0x7fa534156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.870+0000 7fa539c00640 1 -- 172.21.15.42:0/1930289380 >> v1:172.21.15.62:6789/0 conn(0x7fa5340ca050 legacy=0x7fa534156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.870+0000 7fa539c00640 1 -- 172.21.15.42:0/1930289380 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340ca550 con 0x7fa5340ad960 2024-08-17T02:27:34.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.870+0000 7fa533e00640 1 -- 172.21.15.42:0/1930289380 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126186077 0 0) 0x7fa520001110 con 0x7fa5340ca050 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.871+0000 7fa539c00640 1 --2- 172.21.15.42:0/1930289380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 0x7fa53415b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa528009910 tx=0x7fa5280091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15642c89f1bfd57c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.871+0000 7fa533e00640 1 -- 172.21.15.42:0/1930289380 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528032440 con 0x7fa5340ad960 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.871+0000 7fa533e00640 1 -- 172.21.15.42:0/1930289380 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280325a0 con 0x7fa5340ad960 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.871+0000 7fa533e00640 1 -- 172.21.15.42:0/1930289380 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528032940 con 0x7fa5340ad960 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.871+0000 7fa53c600640 1 -- 172.21.15.42:0/1930289380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 msgr2=0x7fa53415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.871+0000 7fa53c600640 1 --2- 172.21.15.42:0/1930289380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 0x7fa53415b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa528009910 tx=0x7fa5280091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.872+0000 7fa53c600640 1 -- 172.21.15.42:0/1930289380 shutdown_connections 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.872+0000 7fa53c600640 1 --2- 172.21.15.42:0/1930289380 >> v2:172.21.15.62:3300/0 conn(0x7fa5340add30 0x7fa534156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.872+0000 7fa53c600640 1 --2- 172.21.15.42:0/1930289380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ad960 0x7fa53415b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.872+0000 7fa53c600640 1 -- 172.21.15.42:0/1930289380 >> 172.21.15.42:0/1930289380 conn(0x7fa534066e60 msgr2=0x7fa534067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.872+0000 7fa53c600640 1 -- 172.21.15.42:0/1930289380 shutdown_connections 2024-08-17T02:27:34.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.872+0000 7fa53c600640 1 -- 172.21.15.42:0/1930289380 wait complete. 2024-08-17T02:27:34.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.873+0000 7fa53c600640 1 Processor -- start 2024-08-17T02:27:34.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.873+0000 7fa53c600640 1 -- start start 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53c600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 0x7fa5340ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53c600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5340add30 0x7fa53414b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53c600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ca050 0x7fa534169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53c600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53414c440 con 0x7fa5340ad960 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53c600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340a8aa0 con 0x7fa5340add30 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53c600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53416a220 con 0x7fa5340ca050 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa539c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 0x7fa5340ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa539c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 0x7fa5340ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43970/0 (socket says 172.21.15.42:43970) 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa539c00640 1 -- 172.21.15.42:0/2944026128 learned_addr learned my addr 172.21.15.42:0/2944026128 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa53a600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ca050 0x7fa534169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.874+0000 7fa539200640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5340add30 0x7fa53414b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa539c00640 1 -- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ca050 msgr2=0x7fa534169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa539c00640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ca050 0x7fa534169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa539c00640 1 -- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5340add30 msgr2=0x7fa53414b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa539c00640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5340add30 0x7fa53414b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa539c00640 1 -- 172.21.15.42:0/2944026128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009450 con 0x7fa5340ad960 2024-08-17T02:27:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa539c00640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 0x7fa5340ad0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa528009970 tx=0x7fa528032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528006b30 con 0x7fa5340ad960 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528032710 con 0x7fa5340ad960 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa534169980 con 0x7fa5340ad960 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52803e450 con 0x7fa5340ad960 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.875+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa534169f40 con 0x7fa5340ad960 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.876+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa534063fb0 con 0x7fa5340ad960 2024-08-17T02:27:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.877+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa52803c400 con 0x7fa5340ad960 2024-08-17T02:27:34.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.878+0000 7fa530c00640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa514065150 0x7fa514067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.878+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5280a2b80 con 0x7fa5340ad960 2024-08-17T02:27:34.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.878+0000 7fa539200640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa514065150 0x7fa514067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.879+0000 7fa539200640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa514065150 0x7fa514067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5340aab50 tx=0x7fa520007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:34.882+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa528070c50 con 0x7fa5340ad960 2024-08-17T02:27:35.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.064+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5340a8be0 con 0x7fa514065150 2024-08-17T02:27:35.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.071+0000 7fa530c00640 1 -- 172.21.15.42:0/2944026128 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264550 (secure 0 0 0) 0x7fa52000f810 con 0x7fa514065150 2024-08-17T02:27:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:35.076 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:27:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.075+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa514065150 msgr2=0x7fa514067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.075+0000 7fa53c600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa514065150 0x7fa514067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5340aab50 tx=0x7fa520007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.075+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 msgr2=0x7fa5340ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.075+0000 7fa53c600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 0x7fa5340ad0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa528009970 tx=0x7fa528032000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 shutdown_connections 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa514065150 0x7fa514067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa5340ca050 0x7fa534169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5340add30 0x7fa53414b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 --2- 172.21.15.42:0/2944026128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5340ad960 0x7fa5340ad0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 >> 172.21.15.42:0/2944026128 conn(0x7fa534066e60 msgr2=0x7fa5341565b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 shutdown_connections 2024-08-17T02:27:35.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.076+0000 7fa53c600640 1 -- 172.21.15.42:0/2944026128 wait complete. 2024-08-17T02:27:35.092 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:27:33.184449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398644,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576076,"statfs":{"total":773094113280,"available":770637901824,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001627"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461874+0000","last_change":"2024-08-17T02:27:25.455330+0000","last_active":"2024-08-17T02:27:25.461874+0000","last_peered":"2024-08-17T02:27:25.461874+0000","last_clean":"2024-08-17T02:27:25.461874+0000","last_became_active":"2024-08-17T02:27:25.455125+0000","last_became_peered":"2024-08-17T02:27:25.455125+0000","last_unstale":"2024-08-17T02:27:25.461874+0000","last_undegraded":"2024-08-17T02:27:25.461874+0000","last_fullsized":"2024-08-17T02:27:25.461874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459752+0000","last_change":"2024-08-17T02:27:25.453226+0000","last_active":"2024-08-17T02:27:25.459752+0000","last_peered":"2024-08-17T02:27:25.459752+0000","last_clean":"2024-08-17T02:27:25.459752+0000","last_became_active":"2024-08-17T02:27:25.452935+0000","last_became_peered":"2024-08-17T02:27:25.452935+0000","last_unstale":"2024-08-17T02:27:25.459752+0000","last_undegraded":"2024-08-17T02:27:25.459752+0000","last_fullsized":"2024-08-17T02:27:25.459752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455153+0000","last_change":"2024-08-17T02:27:25.446924+0000","last_active":"2024-08-17T02:27:25.455153+0000","last_peered":"2024-08-17T02:27:25.455153+0000","last_clean":"2024-08-17T02:27:25.455153+0000","last_became_active":"2024-08-17T02:27:25.446221+0000","last_became_peered":"2024-08-17T02:27:25.446221+0000","last_unstale":"2024-08-17T02:27:25.455153+0000","last_undegraded":"2024-08-17T02:27:25.455153+0000","last_fullsized":"2024-08-17T02:27:25.455153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470821+0000","last_change":"2024-08-17T02:27:25.470009+0000","last_active":"2024-08-17T02:27:25.470821+0000","last_peered":"2024-08-17T02:27:25.470821+0000","last_clean":"2024-08-17T02:27:25.470821+0000","last_became_active":"2024-08-17T02:27:25.469648+0000","last_became_peered":"2024-08-17T02:27:25.469648+0000","last_unstale":"2024-08-17T02:27:25.470821+0000","last_undegraded":"2024-08-17T02:27:25.470821+0000","last_fullsized":"2024-08-17T02:27:25.470821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454890+0000","last_change":"2024-08-17T02:27:25.449603+0000","last_active":"2024-08-17T02:27:25.454890+0000","last_peered":"2024-08-17T02:27:25.454890+0000","last_clean":"2024-08-17T02:27:25.454890+0000","last_became_active":"2024-08-17T02:27:25.449260+0000","last_became_peered":"2024-08-17T02:27:25.449260+0000","last_unstale":"2024-08-17T02:27:25.454890+0000","last_undegraded":"2024-08-17T02:27:25.454890+0000","last_fullsized":"2024-08-17T02:27:25.454890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456632+0000","last_change":"2024-08-17T02:27:25.452008+0000","last_active":"2024-08-17T02:27:25.456632+0000","last_peered":"2024-08-17T02:27:25.456632+0000","last_clean":"2024-08-17T02:27:25.456632+0000","last_became_active":"2024-08-17T02:27:25.451745+0000","last_became_peered":"2024-08-17T02:27:25.451745+0000","last_unstale":"2024-08-17T02:27:25.456632+0000","last_undegraded":"2024-08-17T02:27:25.456632+0000","last_fullsized":"2024-08-17T02:27:25.456632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462102+0000","last_change":"2024-08-17T02:27:25.456866+0000","last_active":"2024-08-17T02:27:25.462102+0000","last_peered":"2024-08-17T02:27:25.462102+0000","last_clean":"2024-08-17T02:27:25.462102+0000","last_became_active":"2024-08-17T02:27:25.456558+0000","last_became_peered":"2024-08-17T02:27:25.456558+0000","last_unstale":"2024-08-17T02:27:25.462102+0000","last_undegraded":"2024-08-17T02:27:25.462102+0000","last_fullsized":"2024-08-17T02:27:25.462102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:32:17.102232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466556+0000","last_change":"2024-08-17T02:27:25.455754+0000","last_active":"2024-08-17T02:27:25.466556+0000","last_peered":"2024-08-17T02:27:25.466556+0000","last_clean":"2024-08-17T02:27:25.466556+0000","last_became_active":"2024-08-17T02:27:25.449947+0000","last_became_peered":"2024-08-17T02:27:25.449947+0000","last_unstale":"2024-08-17T02:27:25.466556+0000","last_undegraded":"2024-08-17T02:27:25.466556+0000","last_fullsized":"2024-08-17T02:27:25.466556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460668+0000","last_change":"2024-08-17T02:27:25.451824+0000","last_active":"2024-08-17T02:27:25.460668+0000","last_peered":"2024-08-17T02:27:25.460668+0000","last_clean":"2024-08-17T02:27:25.460668+0000","last_became_active":"2024-08-17T02:27:25.451484+0000","last_became_peered":"2024-08-17T02:27:25.451484+0000","last_unstale":"2024-08-17T02:27:25.460668+0000","last_undegraded":"2024-08-17T02:27:25.460668+0000","last_fullsized":"2024-08-17T02:27:25.460668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438873+0000","last_change":"2024-08-17T02:27:25.437579+0000","last_active":"2024-08-17T02:27:25.438873+0000","last_peered":"2024-08-17T02:27:25.438873+0000","last_clean":"2024-08-17T02:27:25.438873+0000","last_became_active":"2024-08-17T02:27:25.437293+0000","last_became_peered":"2024-08-17T02:27:25.437293+0000","last_unstale":"2024-08-17T02:27:25.438873+0000","last_undegraded":"2024-08-17T02:27:25.438873+0000","last_fullsized":"2024-08-17T02:27:25.438873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451016+0000","last_change":"2024-08-17T02:27:25.439072+0000","last_active":"2024-08-17T02:27:25.451016+0000","last_peered":"2024-08-17T02:27:25.451016+0000","last_clean":"2024-08-17T02:27:25.451016+0000","last_became_active":"2024-08-17T02:27:25.438775+0000","last_became_peered":"2024-08-17T02:27:25.438775+0000","last_unstale":"2024-08-17T02:27:25.451016+0000","last_undegraded":"2024-08-17T02:27:25.451016+0000","last_fullsized":"2024-08-17T02:27:25.451016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441975+0000","last_change":"2024-08-17T02:27:25.435276+0000","last_active":"2024-08-17T02:27:25.441975+0000","last_peered":"2024-08-17T02:27:25.441975+0000","last_clean":"2024-08-17T02:27:25.441975+0000","last_became_active":"2024-08-17T02:27:25.433425+0000","last_became_peered":"2024-08-17T02:27:25.433425+0000","last_unstale":"2024-08-17T02:27:25.441975+0000","last_undegraded":"2024-08-17T02:27:25.441975+0000","last_fullsized":"2024-08-17T02:27:25.441975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461122+0000","last_change":"2024-08-17T02:27:25.441556+0000","last_active":"2024-08-17T02:27:25.461122+0000","last_peered":"2024-08-17T02:27:25.461122+0000","last_clean":"2024-08-17T02:27:25.461122+0000","last_became_active":"2024-08-17T02:27:25.441313+0000","last_became_peered":"2024-08-17T02:27:25.441313+0000","last_unstale":"2024-08-17T02:27:25.461122+0000","last_undegraded":"2024-08-17T02:27:25.461122+0000","last_fullsized":"2024-08-17T02:27:25.461122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454910+0000","last_change":"2024-08-17T02:27:25.450943+0000","last_active":"2024-08-17T02:27:25.454910+0000","last_peered":"2024-08-17T02:27:25.454910+0000","last_clean":"2024-08-17T02:27:25.454910+0000","last_became_active":"2024-08-17T02:27:25.449195+0000","last_became_peered":"2024-08-17T02:27:25.449195+0000","last_unstale":"2024-08-17T02:27:25.454910+0000","last_undegraded":"2024-08-17T02:27:25.454910+0000","last_fullsized":"2024-08-17T02:27:25.454910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439145+0000","last_change":"2024-08-17T02:27:25.436204+0000","last_active":"2024-08-17T02:27:25.439145+0000","last_peered":"2024-08-17T02:27:25.439145+0000","last_clean":"2024-08-17T02:27:25.439145+0000","last_became_active":"2024-08-17T02:27:25.435925+0000","last_became_peered":"2024-08-17T02:27:25.435925+0000","last_unstale":"2024-08-17T02:27:25.439145+0000","last_undegraded":"2024-08-17T02:27:25.439145+0000","last_fullsized":"2024-08-17T02:27:25.439145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456664+0000","last_change":"2024-08-17T02:27:25.452597+0000","last_active":"2024-08-17T02:27:25.456664+0000","last_peered":"2024-08-17T02:27:25.456664+0000","last_clean":"2024-08-17T02:27:25.456664+0000","last_became_active":"2024-08-17T02:27:25.452396+0000","last_became_peered":"2024-08-17T02:27:25.452396+0000","last_unstale":"2024-08-17T02:27:25.456664+0000","last_undegraded":"2024-08-17T02:27:25.456664+0000","last_fullsized":"2024-08-17T02:27:25.456664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451355+0000","last_change":"2024-08-17T02:27:25.448186+0000","last_active":"2024-08-17T02:27:25.451355+0000","last_peered":"2024-08-17T02:27:25.451355+0000","last_clean":"2024-08-17T02:27:25.451355+0000","last_became_active":"2024-08-17T02:27:25.446348+0000","last_became_peered":"2024-08-17T02:27:25.446348+0000","last_unstale":"2024-08-17T02:27:25.451355+0000","last_undegraded":"2024-08-17T02:27:25.451355+0000","last_fullsized":"2024-08-17T02:27:25.451355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:32:41.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446526+0000","last_change":"2024-08-17T02:27:25.440779+0000","last_active":"2024-08-17T02:27:25.446526+0000","last_peered":"2024-08-17T02:27:25.446526+0000","last_clean":"2024-08-17T02:27:25.446526+0000","last_became_active":"2024-08-17T02:27:25.440337+0000","last_became_peered":"2024-08-17T02:27:25.440337+0000","last_unstale":"2024-08-17T02:27:25.446526+0000","last_undegraded":"2024-08-17T02:27:25.446526+0000","last_fullsized":"2024-08-17T02:27:25.446526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:52.062574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456529+0000","last_change":"2024-08-17T02:27:25.449909+0000","last_active":"2024-08-17T02:27:25.456529+0000","last_peered":"2024-08-17T02:27:25.456529+0000","last_clean":"2024-08-17T02:27:25.456529+0000","last_became_active":"2024-08-17T02:27:25.449657+0000","last_became_peered":"2024-08-17T02:27:25.449657+0000","last_unstale":"2024-08-17T02:27:25.456529+0000","last_undegraded":"2024-08-17T02:27:25.456529+0000","last_fullsized":"2024-08-17T02:27:25.456529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451092+0000","last_change":"2024-08-17T02:27:25.439755+0000","last_active":"2024-08-17T02:27:25.451092+0000","last_peered":"2024-08-17T02:27:25.451092+0000","last_clean":"2024-08-17T02:27:25.451092+0000","last_became_active":"2024-08-17T02:27:25.439512+0000","last_became_peered":"2024-08-17T02:27:25.439512+0000","last_unstale":"2024-08-17T02:27:25.451092+0000","last_undegraded":"2024-08-17T02:27:25.451092+0000","last_fullsized":"2024-08-17T02:27:25.451092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451164+0000","last_change":"2024-08-17T02:27:25.445422+0000","last_active":"2024-08-17T02:27:25.451164+0000","last_peered":"2024-08-17T02:27:25.451164+0000","last_clean":"2024-08-17T02:27:25.451164+0000","last_became_active":"2024-08-17T02:27:25.445153+0000","last_became_peered":"2024-08-17T02:27:25.445153+0000","last_unstale":"2024-08-17T02:27:25.451164+0000","last_undegraded":"2024-08-17T02:27:25.451164+0000","last_fullsized":"2024-08-17T02:27:25.451164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450548+0000","last_change":"2024-08-17T02:27:25.445499+0000","last_active":"2024-08-17T02:27:25.450548+0000","last_peered":"2024-08-17T02:27:25.450548+0000","last_clean":"2024-08-17T02:27:25.450548+0000","last_became_active":"2024-08-17T02:27:25.445127+0000","last_became_peered":"2024-08-17T02:27:25.445127+0000","last_unstale":"2024-08-17T02:27:25.450548+0000","last_undegraded":"2024-08-17T02:27:25.450548+0000","last_fullsized":"2024-08-17T02:27:25.450548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466499+0000","last_change":"2024-08-17T02:27:25.460811+0000","last_active":"2024-08-17T02:27:25.466499+0000","last_peered":"2024-08-17T02:27:25.466499+0000","last_clean":"2024-08-17T02:27:25.466499+0000","last_became_active":"2024-08-17T02:27:25.460513+0000","last_became_peered":"2024-08-17T02:27:25.460513+0000","last_unstale":"2024-08-17T02:27:25.466499+0000","last_undegraded":"2024-08-17T02:27:25.466499+0000","last_fullsized":"2024-08-17T02:27:25.466499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468295+0000","last_change":"2024-08-17T02:27:25.466496+0000","last_active":"2024-08-17T02:27:25.468295+0000","last_peered":"2024-08-17T02:27:25.468295+0000","last_clean":"2024-08-17T02:27:25.468295+0000","last_became_active":"2024-08-17T02:27:25.466240+0000","last_became_peered":"2024-08-17T02:27:25.466240+0000","last_unstale":"2024-08-17T02:27:25.468295+0000","last_undegraded":"2024-08-17T02:27:25.468295+0000","last_fullsized":"2024-08-17T02:27:25.468295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467606+0000","last_change":"2024-08-17T02:27:25.461454+0000","last_active":"2024-08-17T02:27:25.467606+0000","last_peered":"2024-08-17T02:27:25.467606+0000","last_clean":"2024-08-17T02:27:25.467606+0000","last_became_active":"2024-08-17T02:27:25.460585+0000","last_became_peered":"2024-08-17T02:27:25.460585+0000","last_unstale":"2024-08-17T02:27:25.467606+0000","last_undegraded":"2024-08-17T02:27:25.467606+0000","last_fullsized":"2024-08-17T02:27:25.467606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.452006+0000","last_change":"2024-08-17T02:27:25.440879+0000","last_active":"2024-08-17T02:27:25.452006+0000","last_peered":"2024-08-17T02:27:25.452006+0000","last_clean":"2024-08-17T02:27:25.452006+0000","last_became_active":"2024-08-17T02:27:25.440638+0000","last_became_peered":"2024-08-17T02:27:25.440638+0000","last_unstale":"2024-08-17T02:27:25.452006+0000","last_undegraded":"2024-08-17T02:27:25.452006+0000","last_fullsized":"2024-08-17T02:27:25.452006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465682+0000","last_change":"2024-08-17T02:27:25.463971+0000","last_active":"2024-08-17T02:27:25.465682+0000","last_peered":"2024-08-17T02:27:25.465682+0000","last_clean":"2024-08-17T02:27:25.465682+0000","last_became_active":"2024-08-17T02:27:25.463657+0000","last_became_peered":"2024-08-17T02:27:25.463657+0000","last_unstale":"2024-08-17T02:27:25.465682+0000","last_undegraded":"2024-08-17T02:27:25.465682+0000","last_fullsized":"2024-08-17T02:27:25.465682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:30:58.716009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465530+0000","last_change":"2024-08-17T02:27:25.450808+0000","last_active":"2024-08-17T02:27:25.465530+0000","last_peered":"2024-08-17T02:27:25.465530+0000","last_clean":"2024-08-17T02:27:25.465530+0000","last_became_active":"2024-08-17T02:27:25.450474+0000","last_became_peered":"2024-08-17T02:27:25.450474+0000","last_unstale":"2024-08-17T02:27:25.465530+0000","last_undegraded":"2024-08-17T02:27:25.465530+0000","last_fullsized":"2024-08-17T02:27:25.465530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464102+0000","last_change":"2024-08-17T02:27:25.462561+0000","last_active":"2024-08-17T02:27:25.464102+0000","last_peered":"2024-08-17T02:27:25.464102+0000","last_clean":"2024-08-17T02:27:25.464102+0000","last_became_active":"2024-08-17T02:27:25.462314+0000","last_became_peered":"2024-08-17T02:27:25.462314+0000","last_unstale":"2024-08-17T02:27:25.464102+0000","last_undegraded":"2024-08-17T02:27:25.464102+0000","last_fullsized":"2024-08-17T02:27:25.464102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:49:55.384786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468210+0000","last_change":"2024-08-17T02:27:25.465776+0000","last_active":"2024-08-17T02:27:25.468210+0000","last_peered":"2024-08-17T02:27:25.468210+0000","last_clean":"2024-08-17T02:27:25.468210+0000","last_became_active":"2024-08-17T02:27:25.465517+0000","last_became_peered":"2024-08-17T02:27:25.465517+0000","last_unstale":"2024-08-17T02:27:25.468210+0000","last_undegraded":"2024-08-17T02:27:25.468210+0000","last_fullsized":"2024-08-17T02:27:25.468210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.446395+0000","last_change":"2024-08-17T02:27:25.436230+0000","last_active":"2024-08-17T02:27:25.446395+0000","last_peered":"2024-08-17T02:27:25.446395+0000","last_clean":"2024-08-17T02:27:25.446395+0000","last_became_active":"2024-08-17T02:27:25.435981+0000","last_became_peered":"2024-08-17T02:27:25.435981+0000","last_unstale":"2024-08-17T02:27:25.446395+0000","last_undegraded":"2024-08-17T02:27:25.446395+0000","last_fullsized":"2024-08-17T02:27:25.446395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455807+0000","last_change":"2024-08-17T02:27:25.453066+0000","last_active":"2024-08-17T02:27:25.455807+0000","last_peered":"2024-08-17T02:27:25.455807+0000","last_clean":"2024-08-17T02:27:25.455807+0000","last_became_active":"2024-08-17T02:27:25.452821+0000","last_became_peered":"2024-08-17T02:27:25.452821+0000","last_unstale":"2024-08-17T02:27:25.455807+0000","last_undegraded":"2024-08-17T02:27:25.455807+0000","last_fullsized":"2024-08-17T02:27:25.455807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:07:02.474407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.441899+0000","last_change":"2024-08-17T02:27:25.430552+0000","last_active":"2024-08-17T02:27:25.441899+0000","last_peered":"2024-08-17T02:27:25.441899+0000","last_clean":"2024-08-17T02:27:25.441899+0000","last_became_active":"2024-08-17T02:27:25.429351+0000","last_became_peered":"2024-08-17T02:27:25.429351+0000","last_unstale":"2024-08-17T02:27:25.441899+0000","last_undegraded":"2024-08-17T02:27:25.441899+0000","last_fullsized":"2024-08-17T02:27:25.441899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:57.515905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470407+0000","last_change":"2024-08-17T02:27:24.450643+0000","last_active":"2024-08-17T02:27:25.470407+0000","last_peered":"2024-08-17T02:27:25.470407+0000","last_clean":"2024-08-17T02:27:25.470407+0000","last_became_active":"2024-08-17T02:27:24.450201+0000","last_became_peered":"2024-08-17T02:27:24.450201+0000","last_unstale":"2024-08-17T02:27:25.470407+0000","last_undegraded":"2024-08-17T02:27:25.470407+0000","last_fullsized":"2024-08-17T02:27:25.470407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.451185+0000","last_change":"2024-08-17T02:27:25.445553+0000","last_active":"2024-08-17T02:27:25.451185+0000","last_peered":"2024-08-17T02:27:25.451185+0000","last_clean":"2024-08-17T02:27:25.451185+0000","last_became_active":"2024-08-17T02:27:25.445275+0000","last_became_peered":"2024-08-17T02:27:25.445275+0000","last_unstale":"2024-08-17T02:27:25.451185+0000","last_undegraded":"2024-08-17T02:27:25.451185+0000","last_fullsized":"2024-08-17T02:27:25.451185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461254+0000","last_change":"2024-08-17T02:27:24.439165+0000","last_active":"2024-08-17T02:27:25.461254+0000","last_peered":"2024-08-17T02:27:25.461254+0000","last_clean":"2024-08-17T02:27:25.461254+0000","last_became_active":"2024-08-17T02:27:24.437397+0000","last_became_peered":"2024-08-17T02:27:24.437397+0000","last_unstale":"2024-08-17T02:27:25.461254+0000","last_undegraded":"2024-08-17T02:27:25.461254+0000","last_fullsized":"2024-08-17T02:27:25.461254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.429962+0000","last_change":"2024-08-17T02:27:24.445238+0000","last_active":"2024-08-17T02:27:25.429962+0000","last_peered":"2024-08-17T02:27:25.429962+0000","last_clean":"2024-08-17T02:27:25.429962+0000","last_became_active":"2024-08-17T02:27:24.444156+0000","last_became_peered":"2024-08-17T02:27:24.444156+0000","last_unstale":"2024-08-17T02:27:25.429962+0000","last_undegraded":"2024-08-17T02:27:25.429962+0000","last_fullsized":"2024-08-17T02:27:25.429962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466566+0000","last_change":"2024-08-17T02:27:25.456302+0000","last_active":"2024-08-17T02:27:25.466566+0000","last_peered":"2024-08-17T02:27:25.466566+0000","last_clean":"2024-08-17T02:27:25.466566+0000","last_became_active":"2024-08-17T02:27:25.456006+0000","last_became_peered":"2024-08-17T02:27:25.456006+0000","last_unstale":"2024-08-17T02:27:25.466566+0000","last_undegraded":"2024-08-17T02:27:25.466566+0000","last_fullsized":"2024-08-17T02:27:25.466566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.430567+0000","last_change":"2024-08-17T02:27:24.442260+0000","last_active":"2024-08-17T02:27:25.430567+0000","last_peered":"2024-08-17T02:27:25.430567+0000","last_clean":"2024-08-17T02:27:25.430567+0000","last_became_active":"2024-08-17T02:27:24.440158+0000","last_became_peered":"2024-08-17T02:27:24.440158+0000","last_unstale":"2024-08-17T02:27:25.430567+0000","last_undegraded":"2024-08-17T02:27:25.430567+0000","last_fullsized":"2024-08-17T02:27:25.430567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.442431+0000","last_change":"2024-08-17T02:27:25.439235+0000","last_active":"2024-08-17T02:27:25.442431+0000","last_peered":"2024-08-17T02:27:25.442431+0000","last_clean":"2024-08-17T02:27:25.442431+0000","last_became_active":"2024-08-17T02:27:25.438932+0000","last_became_peered":"2024-08-17T02:27:25.438932+0000","last_unstale":"2024-08-17T02:27:25.442431+0000","last_undegraded":"2024-08-17T02:27:25.442431+0000","last_fullsized":"2024-08-17T02:27:25.442431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.426017+0000","last_change":"2024-08-17T02:27:24.439888+0000","last_active":"2024-08-17T02:27:25.426017+0000","last_peered":"2024-08-17T02:27:25.426017+0000","last_clean":"2024-08-17T02:27:25.426017+0000","last_became_active":"2024-08-17T02:27:24.439256+0000","last_became_peered":"2024-08-17T02:27:24.439256+0000","last_unstale":"2024-08-17T02:27:25.426017+0000","last_undegraded":"2024-08-17T02:27:25.426017+0000","last_fullsized":"2024-08-17T02:27:25.426017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450765+0000","last_change":"2024-08-17T02:27:25.445654+0000","last_active":"2024-08-17T02:27:25.450765+0000","last_peered":"2024-08-17T02:27:25.450765+0000","last_clean":"2024-08-17T02:27:25.450765+0000","last_became_active":"2024-08-17T02:27:25.445315+0000","last_became_peered":"2024-08-17T02:27:25.445315+0000","last_unstale":"2024-08-17T02:27:25.450765+0000","last_undegraded":"2024-08-17T02:27:25.450765+0000","last_fullsized":"2024-08-17T02:27:25.450765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:03.338457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431851+0000","last_change":"2024-08-17T02:27:24.439678+0000","last_active":"2024-08-17T02:27:25.431851+0000","last_peered":"2024-08-17T02:27:25.431851+0000","last_clean":"2024-08-17T02:27:25.431851+0000","last_became_active":"2024-08-17T02:27:24.438827+0000","last_became_peered":"2024-08-17T02:27:24.438827+0000","last_unstale":"2024-08-17T02:27:25.431851+0000","last_undegraded":"2024-08-17T02:27:25.431851+0000","last_fullsized":"2024-08-17T02:27:25.431851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453338+0000","last_change":"2024-08-17T02:27:25.446818+0000","last_active":"2024-08-17T02:27:25.453338+0000","last_peered":"2024-08-17T02:27:25.453338+0000","last_clean":"2024-08-17T02:27:25.453338+0000","last_became_active":"2024-08-17T02:27:25.446160+0000","last_became_peered":"2024-08-17T02:27:25.446160+0000","last_unstale":"2024-08-17T02:27:25.453338+0000","last_undegraded":"2024-08-17T02:27:25.453338+0000","last_fullsized":"2024-08-17T02:27:25.453338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461740+0000","last_change":"2024-08-17T02:27:24.444574+0000","last_active":"2024-08-17T02:27:25.461740+0000","last_peered":"2024-08-17T02:27:25.461740+0000","last_clean":"2024-08-17T02:27:25.461740+0000","last_became_active":"2024-08-17T02:27:24.444333+0000","last_became_peered":"2024-08-17T02:27:24.444333+0000","last_unstale":"2024-08-17T02:27:25.461740+0000","last_undegraded":"2024-08-17T02:27:25.461740+0000","last_fullsized":"2024-08-17T02:27:25.461740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457512+0000","last_change":"2024-08-17T02:27:25.444360+0000","last_active":"2024-08-17T02:27:25.457512+0000","last_peered":"2024-08-17T02:27:25.457512+0000","last_clean":"2024-08-17T02:27:25.457512+0000","last_became_active":"2024-08-17T02:27:25.444106+0000","last_became_peered":"2024-08-17T02:27:25.444106+0000","last_unstale":"2024-08-17T02:27:25.457512+0000","last_undegraded":"2024-08-17T02:27:25.457512+0000","last_fullsized":"2024-08-17T02:27:25.457512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:43.203136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.472906+0000","last_change":"2024-08-17T02:27:24.445437+0000","last_active":"2024-08-17T02:27:25.472906+0000","last_peered":"2024-08-17T02:27:25.472906+0000","last_clean":"2024-08-17T02:27:25.472906+0000","last_became_active":"2024-08-17T02:27:24.445008+0000","last_became_peered":"2024-08-17T02:27:24.445008+0000","last_unstale":"2024-08-17T02:27:25.472906+0000","last_undegraded":"2024-08-17T02:27:25.472906+0000","last_fullsized":"2024-08-17T02:27:25.472906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462054+0000","last_change":"2024-08-17T02:27:25.456825+0000","last_active":"2024-08-17T02:27:25.462054+0000","last_peered":"2024-08-17T02:27:25.462054+0000","last_clean":"2024-08-17T02:27:25.462054+0000","last_became_active":"2024-08-17T02:27:25.456323+0000","last_became_peered":"2024-08-17T02:27:25.456323+0000","last_unstale":"2024-08-17T02:27:25.462054+0000","last_undegraded":"2024-08-17T02:27:25.462054+0000","last_fullsized":"2024-08-17T02:27:25.462054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:05:45.594646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464743+0000","last_change":"2024-08-17T02:27:24.438473+0000","last_active":"2024-08-17T02:27:25.464743+0000","last_peered":"2024-08-17T02:27:25.464743+0000","last_clean":"2024-08-17T02:27:25.464743+0000","last_became_active":"2024-08-17T02:27:24.438205+0000","last_became_peered":"2024-08-17T02:27:24.438205+0000","last_unstale":"2024-08-17T02:27:25.464743+0000","last_undegraded":"2024-08-17T02:27:25.464743+0000","last_fullsized":"2024-08-17T02:27:25.464743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:56.206582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454929+0000","last_change":"2024-08-17T02:27:25.451195+0000","last_active":"2024-08-17T02:27:25.454929+0000","last_peered":"2024-08-17T02:27:25.454929+0000","last_clean":"2024-08-17T02:27:25.454929+0000","last_became_active":"2024-08-17T02:27:25.444332+0000","last_became_peered":"2024-08-17T02:27:25.444332+0000","last_unstale":"2024-08-17T02:27:25.454929+0000","last_undegraded":"2024-08-17T02:27:25.454929+0000","last_fullsized":"2024-08-17T02:27:25.454929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:20:26.521745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431434+0000","last_change":"2024-08-17T02:27:24.444612+0000","last_active":"2024-08-17T02:27:25.431434+0000","last_peered":"2024-08-17T02:27:25.431434+0000","last_clean":"2024-08-17T02:27:25.431434+0000","last_became_active":"2024-08-17T02:27:24.444307+0000","last_became_peered":"2024-08-17T02:27:24.444307+0000","last_unstale":"2024-08-17T02:27:25.431434+0000","last_undegraded":"2024-08-17T02:27:25.431434+0000","last_fullsized":"2024-08-17T02:27:25.431434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462196+0000","last_change":"2024-08-17T02:27:25.458229+0000","last_active":"2024-08-17T02:27:25.462196+0000","last_peered":"2024-08-17T02:27:25.462196+0000","last_clean":"2024-08-17T02:27:25.462196+0000","last_became_active":"2024-08-17T02:27:25.457949+0000","last_became_peered":"2024-08-17T02:27:25.457949+0000","last_unstale":"2024-08-17T02:27:25.462196+0000","last_undegraded":"2024-08-17T02:27:25.462196+0000","last_fullsized":"2024-08-17T02:27:25.462196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425557+0000","last_change":"2024-08-17T02:27:24.435541+0000","last_active":"2024-08-17T02:27:25.425557+0000","last_peered":"2024-08-17T02:27:25.425557+0000","last_clean":"2024-08-17T02:27:25.425557+0000","last_became_active":"2024-08-17T02:27:24.435267+0000","last_became_peered":"2024-08-17T02:27:24.435267+0000","last_unstale":"2024-08-17T02:27:25.425557+0000","last_undegraded":"2024-08-17T02:27:25.425557+0000","last_fullsized":"2024-08-17T02:27:25.425557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453321+0000","last_change":"2024-08-17T02:27:25.442847+0000","last_active":"2024-08-17T02:27:25.453321+0000","last_peered":"2024-08-17T02:27:25.453321+0000","last_clean":"2024-08-17T02:27:25.453321+0000","last_became_active":"2024-08-17T02:27:25.442470+0000","last_became_peered":"2024-08-17T02:27:25.442470+0000","last_unstale":"2024-08-17T02:27:25.453321+0000","last_undegraded":"2024-08-17T02:27:25.453321+0000","last_fullsized":"2024-08-17T02:27:25.453321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:50.390710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464153+0000","last_change":"2024-08-17T02:27:24.437545+0000","last_active":"2024-08-17T02:27:25.464153+0000","last_peered":"2024-08-17T02:27:25.464153+0000","last_clean":"2024-08-17T02:27:25.464153+0000","last_became_active":"2024-08-17T02:27:24.437177+0000","last_became_peered":"2024-08-17T02:27:24.437177+0000","last_unstale":"2024-08-17T02:27:25.464153+0000","last_undegraded":"2024-08-17T02:27:25.464153+0000","last_fullsized":"2024-08-17T02:27:25.464153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462291+0000","last_change":"2024-08-17T02:27:25.458884+0000","last_active":"2024-08-17T02:27:25.462291+0000","last_peered":"2024-08-17T02:27:25.462291+0000","last_clean":"2024-08-17T02:27:25.462291+0000","last_became_active":"2024-08-17T02:27:25.458541+0000","last_became_peered":"2024-08-17T02:27:25.458541+0000","last_unstale":"2024-08-17T02:27:25.462291+0000","last_undegraded":"2024-08-17T02:27:25.462291+0000","last_fullsized":"2024-08-17T02:27:25.462291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461445+0000","last_change":"2024-08-17T02:27:24.438345+0000","last_active":"2024-08-17T02:27:25.461445+0000","last_peered":"2024-08-17T02:27:25.461445+0000","last_clean":"2024-08-17T02:27:25.461445+0000","last_became_active":"2024-08-17T02:27:24.438014+0000","last_became_peered":"2024-08-17T02:27:24.438014+0000","last_unstale":"2024-08-17T02:27:25.461445+0000","last_undegraded":"2024-08-17T02:27:25.461445+0000","last_fullsized":"2024-08-17T02:27:25.461445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:51.236659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460458+0000","last_change":"2024-08-17T02:27:25.451119+0000","last_active":"2024-08-17T02:27:25.460458+0000","last_peered":"2024-08-17T02:27:25.460458+0000","last_clean":"2024-08-17T02:27:25.460458+0000","last_became_active":"2024-08-17T02:27:25.450850+0000","last_became_peered":"2024-08-17T02:27:25.450850+0000","last_unstale":"2024-08-17T02:27:25.460458+0000","last_undegraded":"2024-08-17T02:27:25.460458+0000","last_fullsized":"2024-08-17T02:27:25.460458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:31.471714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.466776+0000","last_change":"2024-08-17T02:27:24.448256+0000","last_active":"2024-08-17T02:27:25.466776+0000","last_peered":"2024-08-17T02:27:25.466776+0000","last_clean":"2024-08-17T02:27:25.466776+0000","last_became_active":"2024-08-17T02:27:24.447922+0000","last_became_peered":"2024-08-17T02:27:24.447922+0000","last_unstale":"2024-08-17T02:27:25.466776+0000","last_undegraded":"2024-08-17T02:27:25.466776+0000","last_fullsized":"2024-08-17T02:27:25.466776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.462323+0000","last_change":"2024-08-17T02:27:25.458937+0000","last_active":"2024-08-17T02:27:25.462323+0000","last_peered":"2024-08-17T02:27:25.462323+0000","last_clean":"2024-08-17T02:27:25.462323+0000","last_became_active":"2024-08-17T02:27:25.458689+0000","last_became_peered":"2024-08-17T02:27:25.458689+0000","last_unstale":"2024-08-17T02:27:25.462323+0000","last_undegraded":"2024-08-17T02:27:25.462323+0000","last_fullsized":"2024-08-17T02:27:25.462323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461606+0000","last_change":"2024-08-17T02:27:24.436502+0000","last_active":"2024-08-17T02:27:25.461606+0000","last_peered":"2024-08-17T02:27:25.461606+0000","last_clean":"2024-08-17T02:27:25.461606+0000","last_became_active":"2024-08-17T02:27:24.435360+0000","last_became_peered":"2024-08-17T02:27:24.435360+0000","last_unstale":"2024-08-17T02:27:25.461606+0000","last_undegraded":"2024-08-17T02:27:25.461606+0000","last_fullsized":"2024-08-17T02:27:25.461606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467392+0000","last_change":"2024-08-17T02:27:25.465732+0000","last_active":"2024-08-17T02:27:25.467392+0000","last_peered":"2024-08-17T02:27:25.467392+0000","last_clean":"2024-08-17T02:27:25.467392+0000","last_became_active":"2024-08-17T02:27:25.465477+0000","last_became_peered":"2024-08-17T02:27:25.465477+0000","last_unstale":"2024-08-17T02:27:25.467392+0000","last_undegraded":"2024-08-17T02:27:25.467392+0000","last_fullsized":"2024-08-17T02:27:25.467392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:54.340752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.436763+0000","last_change":"2024-08-17T02:27:24.447436+0000","last_active":"2024-08-17T02:27:25.436763+0000","last_peered":"2024-08-17T02:27:25.436763+0000","last_clean":"2024-08-17T02:27:25.436763+0000","last_became_active":"2024-08-17T02:27:24.446567+0000","last_became_peered":"2024-08-17T02:27:24.446567+0000","last_unstale":"2024-08-17T02:27:25.436763+0000","last_undegraded":"2024-08-17T02:27:25.436763+0000","last_fullsized":"2024-08-17T02:27:25.436763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:27:47.677700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.461787+0000","last_change":"2024-08-17T02:27:25.453401+0000","last_active":"2024-08-17T02:27:25.461787+0000","last_peered":"2024-08-17T02:27:25.461787+0000","last_clean":"2024-08-17T02:27:25.461787+0000","last_became_active":"2024-08-17T02:27:25.453012+0000","last_became_peered":"2024-08-17T02:27:25.453012+0000","last_unstale":"2024-08-17T02:27:25.461787+0000","last_undegraded":"2024-08-17T02:27:25.461787+0000","last_fullsized":"2024-08-17T02:27:25.461787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:27.137025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434221+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:27:25.434221+0000","last_peered":"2024-08-17T02:27:25.434221+0000","last_clean":"2024-08-17T02:27:25.434221+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:27:25.434221+0000","last_undegraded":"2024-08-17T02:27:25.434221+0000","last_fullsized":"2024-08-17T02:27:25.434221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.428317+0000","last_change":"2024-08-17T02:27:24.434655+0000","last_active":"2024-08-17T02:27:25.428317+0000","last_peered":"2024-08-17T02:27:25.428317+0000","last_clean":"2024-08-17T02:27:25.428317+0000","last_became_active":"2024-08-17T02:27:24.434310+0000","last_became_peered":"2024-08-17T02:27:24.434310+0000","last_unstale":"2024-08-17T02:27:25.428317+0000","last_undegraded":"2024-08-17T02:27:25.428317+0000","last_fullsized":"2024-08-17T02:27:25.428317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460185+0000","last_change":"2024-08-17T02:27:25.447580+0000","last_active":"2024-08-17T02:27:25.460185+0000","last_peered":"2024-08-17T02:27:25.460185+0000","last_clean":"2024-08-17T02:27:25.460185+0000","last_became_active":"2024-08-17T02:27:25.447348+0000","last_became_peered":"2024-08-17T02:27:25.447348+0000","last_unstale":"2024-08-17T02:27:25.460185+0000","last_undegraded":"2024-08-17T02:27:25.460185+0000","last_fullsized":"2024-08-17T02:27:25.460185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434137+0000","last_change":"2024-08-17T02:27:24.449181+0000","last_active":"2024-08-17T02:27:25.434137+0000","last_peered":"2024-08-17T02:27:25.434137+0000","last_clean":"2024-08-17T02:27:25.434137+0000","last_became_active":"2024-08-17T02:27:24.448621+0000","last_became_peered":"2024-08-17T02:27:24.448621+0000","last_unstale":"2024-08-17T02:27:25.434137+0000","last_undegraded":"2024-08-17T02:27:25.434137+0000","last_fullsized":"2024-08-17T02:27:25.434137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.455088+0000","last_change":"2024-08-17T02:27:25.451371+0000","last_active":"2024-08-17T02:27:25.455088+0000","last_peered":"2024-08-17T02:27:25.455088+0000","last_clean":"2024-08-17T02:27:25.455088+0000","last_became_active":"2024-08-17T02:27:25.451050+0000","last_became_peered":"2024-08-17T02:27:25.451050+0000","last_unstale":"2024-08-17T02:27:25.455088+0000","last_undegraded":"2024-08-17T02:27:25.455088+0000","last_fullsized":"2024-08-17T02:27:25.455088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431977+0000","last_change":"2024-08-17T02:27:24.445048+0000","last_active":"2024-08-17T02:27:25.431977+0000","last_peered":"2024-08-17T02:27:25.431977+0000","last_clean":"2024-08-17T02:27:25.431977+0000","last_became_active":"2024-08-17T02:27:24.444710+0000","last_became_peered":"2024-08-17T02:27:24.444710+0000","last_unstale":"2024-08-17T02:27:25.431977+0000","last_undegraded":"2024-08-17T02:27:25.431977+0000","last_fullsized":"2024-08-17T02:27:25.431977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.444039+0000","last_change":"2024-08-17T02:27:25.440656+0000","last_active":"2024-08-17T02:27:25.444039+0000","last_peered":"2024-08-17T02:27:25.444039+0000","last_clean":"2024-08-17T02:27:25.444039+0000","last_became_active":"2024-08-17T02:27:25.440321+0000","last_became_peered":"2024-08-17T02:27:25.440321+0000","last_unstale":"2024-08-17T02:27:25.444039+0000","last_undegraded":"2024-08-17T02:27:25.444039+0000","last_fullsized":"2024-08-17T02:27:25.444039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:27.048012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.431535+0000","last_change":"2024-08-17T02:27:24.437523+0000","last_active":"2024-08-17T02:27:25.431535+0000","last_peered":"2024-08-17T02:27:25.431535+0000","last_clean":"2024-08-17T02:27:25.431535+0000","last_became_active":"2024-08-17T02:27:24.437285+0000","last_became_peered":"2024-08-17T02:27:24.437285+0000","last_unstale":"2024-08-17T02:27:25.431535+0000","last_undegraded":"2024-08-17T02:27:25.431535+0000","last_fullsized":"2024-08-17T02:27:25.431535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:31:42.198215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.459340+0000","last_change":"2024-08-17T02:27:25.449648+0000","last_active":"2024-08-17T02:27:25.459340+0000","last_peered":"2024-08-17T02:27:25.459340+0000","last_clean":"2024-08-17T02:27:25.459340+0000","last_became_active":"2024-08-17T02:27:25.447084+0000","last_became_peered":"2024-08-17T02:27:25.447084+0000","last_unstale":"2024-08-17T02:27:25.459340+0000","last_undegraded":"2024-08-17T02:27:25.459340+0000","last_fullsized":"2024-08-17T02:27:25.459340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:34.137007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.425327+0000","last_change":"2024-08-17T02:27:24.437263+0000","last_active":"2024-08-17T02:27:25.425327+0000","last_peered":"2024-08-17T02:27:25.425327+0000","last_clean":"2024-08-17T02:27:25.425327+0000","last_became_active":"2024-08-17T02:27:24.436992+0000","last_became_peered":"2024-08-17T02:27:24.436992+0000","last_unstale":"2024-08-17T02:27:25.425327+0000","last_undegraded":"2024-08-17T02:27:25.425327+0000","last_fullsized":"2024-08-17T02:27:25.425327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.468312+0000","last_change":"2024-08-17T02:27:25.466345+0000","last_active":"2024-08-17T02:27:25.468312+0000","last_peered":"2024-08-17T02:27:25.468312+0000","last_clean":"2024-08-17T02:27:25.468312+0000","last_became_active":"2024-08-17T02:27:25.466038+0000","last_became_peered":"2024-08-17T02:27:25.466038+0000","last_unstale":"2024-08-17T02:27:25.468312+0000","last_undegraded":"2024-08-17T02:27:25.468312+0000","last_fullsized":"2024-08-17T02:27:25.468312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:49.275882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.438148+0000","last_change":"2024-08-17T02:27:24.449902+0000","last_active":"2024-08-17T02:27:25.438148+0000","last_peered":"2024-08-17T02:27:25.438148+0000","last_clean":"2024-08-17T02:27:25.438148+0000","last_became_active":"2024-08-17T02:27:24.449525+0000","last_became_peered":"2024-08-17T02:27:24.449525+0000","last_unstale":"2024-08-17T02:27:25.438148+0000","last_undegraded":"2024-08-17T02:27:25.438148+0000","last_fullsized":"2024-08-17T02:27:25.438148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.445653+0000","last_change":"2024-08-17T02:27:25.440529+0000","last_active":"2024-08-17T02:27:25.445653+0000","last_peered":"2024-08-17T02:27:25.445653+0000","last_clean":"2024-08-17T02:27:25.445653+0000","last_became_active":"2024-08-17T02:27:25.440188+0000","last_became_peered":"2024-08-17T02:27:25.440188+0000","last_unstale":"2024-08-17T02:27:25.445653+0000","last_undegraded":"2024-08-17T02:27:25.445653+0000","last_fullsized":"2024-08-17T02:27:25.445653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:26.541464+0000","last_change":"2024-08-17T02:27:24.435826+0000","last_active":"2024-08-17T02:27:26.541464+0000","last_peered":"2024-08-17T02:27:26.541464+0000","last_clean":"2024-08-17T02:27:26.541464+0000","last_became_active":"2024-08-17T02:27:24.435410+0000","last_became_peered":"2024-08-17T02:27:24.435410+0000","last_unstale":"2024-08-17T02:27:26.541464+0000","last_undegraded":"2024-08-17T02:27:26.541464+0000","last_fullsized":"2024-08-17T02:27:26.541464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:30.468219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460275+0000","last_change":"2024-08-17T02:27:25.456094+0000","last_active":"2024-08-17T02:27:25.460275+0000","last_peered":"2024-08-17T02:27:25.460275+0000","last_clean":"2024-08-17T02:27:25.460275+0000","last_became_active":"2024-08-17T02:27:25.454642+0000","last_became_peered":"2024-08-17T02:27:25.454642+0000","last_unstale":"2024-08-17T02:27:25.460275+0000","last_undegraded":"2024-08-17T02:27:25.460275+0000","last_fullsized":"2024-08-17T02:27:25.460275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:50:36.981980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464709+0000","last_change":"2024-08-17T02:27:24.452692+0000","last_active":"2024-08-17T02:27:25.464709+0000","last_peered":"2024-08-17T02:27:25.464709+0000","last_clean":"2024-08-17T02:27:25.464709+0000","last_became_active":"2024-08-17T02:27:24.452303+0000","last_became_peered":"2024-08-17T02:27:24.452303+0000","last_unstale":"2024-08-17T02:27:25.464709+0000","last_undegraded":"2024-08-17T02:27:25.464709+0000","last_fullsized":"2024-08-17T02:27:25.464709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.457334+0000","last_change":"2024-08-17T02:27:25.450938+0000","last_active":"2024-08-17T02:27:25.457334+0000","last_peered":"2024-08-17T02:27:25.457334+0000","last_clean":"2024-08-17T02:27:25.457334+0000","last_became_active":"2024-08-17T02:27:25.442137+0000","last_became_peered":"2024-08-17T02:27:25.442137+0000","last_unstale":"2024-08-17T02:27:25.457334+0000","last_undegraded":"2024-08-17T02:27:25.457334+0000","last_fullsized":"2024-08-17T02:27:25.457334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.434024+0000","last_change":"2024-08-17T02:27:24.447388+0000","last_active":"2024-08-17T02:27:25.434024+0000","last_peered":"2024-08-17T02:27:25.434024+0000","last_clean":"2024-08-17T02:27:25.434024+0000","last_became_active":"2024-08-17T02:27:24.447000+0000","last_became_peered":"2024-08-17T02:27:24.447000+0000","last_unstale":"2024-08-17T02:27:25.434024+0000","last_undegraded":"2024-08-17T02:27:25.434024+0000","last_fullsized":"2024-08-17T02:27:25.434024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:31:56.510983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.458050+0000","last_change":"2024-08-17T02:27:25.448457+0000","last_active":"2024-08-17T02:27:25.458050+0000","last_peered":"2024-08-17T02:27:25.458050+0000","last_clean":"2024-08-17T02:27:25.458050+0000","last_became_active":"2024-08-17T02:27:25.441769+0000","last_became_peered":"2024-08-17T02:27:25.441769+0000","last_unstale":"2024-08-17T02:27:25.458050+0000","last_undegraded":"2024-08-17T02:27:25.458050+0000","last_fullsized":"2024-08-17T02:27:25.458050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:33:31.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424675+0000","last_change":"2024-08-17T02:27:24.443925+0000","last_active":"2024-08-17T02:27:25.424675+0000","last_peered":"2024-08-17T02:27:25.424675+0000","last_clean":"2024-08-17T02:27:25.424675+0000","last_became_active":"2024-08-17T02:27:24.443608+0000","last_became_peered":"2024-08-17T02:27:24.443608+0000","last_unstale":"2024-08-17T02:27:25.424675+0000","last_undegraded":"2024-08-17T02:27:25.424675+0000","last_fullsized":"2024-08-17T02:27:25.424675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:05.985243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467733+0000","last_change":"2024-08-17T02:27:25.462228+0000","last_active":"2024-08-17T02:27:25.467733+0000","last_peered":"2024-08-17T02:27:25.467733+0000","last_clean":"2024-08-17T02:27:25.467733+0000","last_became_active":"2024-08-17T02:27:25.448840+0000","last_became_peered":"2024-08-17T02:27:25.448840+0000","last_unstale":"2024-08-17T02:27:25.467733+0000","last_undegraded":"2024-08-17T02:27:25.467733+0000","last_fullsized":"2024-08-17T02:27:25.467733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:20:33.083658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.424091+0000","last_change":"2024-08-17T02:27:24.445306+0000","last_active":"2024-08-17T02:27:25.424091+0000","last_peered":"2024-08-17T02:27:25.424091+0000","last_clean":"2024-08-17T02:27:25.424091+0000","last_became_active":"2024-08-17T02:27:24.445012+0000","last_became_peered":"2024-08-17T02:27:24.445012+0000","last_unstale":"2024-08-17T02:27:25.424091+0000","last_undegraded":"2024-08-17T02:27:25.424091+0000","last_fullsized":"2024-08-17T02:27:25.424091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.467550+0000","last_change":"2024-08-17T02:27:25.461234+0000","last_active":"2024-08-17T02:27:25.467550+0000","last_peered":"2024-08-17T02:27:25.467550+0000","last_clean":"2024-08-17T02:27:25.467550+0000","last_became_active":"2024-08-17T02:27:25.455041+0000","last_became_peered":"2024-08-17T02:27:25.455041+0000","last_unstale":"2024-08-17T02:27:25.467550+0000","last_undegraded":"2024-08-17T02:27:25.467550+0000","last_fullsized":"2024-08-17T02:27:25.467550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:17.863712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460395+0000","last_change":"2024-08-17T02:27:24.449904+0000","last_active":"2024-08-17T02:27:25.460395+0000","last_peered":"2024-08-17T02:27:25.460395+0000","last_clean":"2024-08-17T02:27:25.460395+0000","last_became_active":"2024-08-17T02:27:24.449492+0000","last_became_peered":"2024-08-17T02:27:24.449492+0000","last_unstale":"2024-08-17T02:27:25.460395+0000","last_undegraded":"2024-08-17T02:27:25.460395+0000","last_fullsized":"2024-08-17T02:27:25.460395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:10.290038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.439656+0000","last_change":"2024-08-17T02:27:25.432877+0000","last_active":"2024-08-17T02:27:25.439656+0000","last_peered":"2024-08-17T02:27:25.439656+0000","last_clean":"2024-08-17T02:27:25.439656+0000","last_became_active":"2024-08-17T02:27:25.432587+0000","last_became_peered":"2024-08-17T02:27:25.432587+0000","last_unstale":"2024-08-17T02:27:25.439656+0000","last_undegraded":"2024-08-17T02:27:25.439656+0000","last_fullsized":"2024-08-17T02:27:25.439656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:26:05.576105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.454969+0000","last_change":"2024-08-17T02:27:25.448549+0000","last_active":"2024-08-17T02:27:25.454969+0000","last_peered":"2024-08-17T02:27:25.454969+0000","last_clean":"2024-08-17T02:27:25.454969+0000","last_became_active":"2024-08-17T02:27:25.448001+0000","last_became_peered":"2024-08-17T02:27:25.448001+0000","last_unstale":"2024-08-17T02:27:25.454969+0000","last_undegraded":"2024-08-17T02:27:25.454969+0000","last_fullsized":"2024-08-17T02:27:25.454969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:11.379779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.460460+0000","last_change":"2024-08-17T02:27:24.450947+0000","last_active":"2024-08-17T02:27:25.460460+0000","last_peered":"2024-08-17T02:27:25.460460+0000","last_clean":"2024-08-17T02:27:25.460460+0000","last_became_active":"2024-08-17T02:27:24.450649+0000","last_became_peered":"2024-08-17T02:27:24.450649+0000","last_unstale":"2024-08-17T02:27:25.460460+0000","last_undegraded":"2024-08-17T02:27:25.460460+0000","last_fullsized":"2024-08-17T02:27:25.460460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:05:33.132085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.450998+0000","last_change":"2024-08-17T02:27:25.446668+0000","last_active":"2024-08-17T02:27:25.450998+0000","last_peered":"2024-08-17T02:27:25.450998+0000","last_clean":"2024-08-17T02:27:25.450998+0000","last_became_active":"2024-08-17T02:27:25.446347+0000","last_became_peered":"2024-08-17T02:27:25.446347+0000","last_unstale":"2024-08-17T02:27:25.450998+0000","last_undegraded":"2024-08-17T02:27:25.450998+0000","last_fullsized":"2024-08-17T02:27:25.450998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.414614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.456596+0000","last_change":"2024-08-17T02:27:24.451135+0000","last_active":"2024-08-17T02:27:25.456596+0000","last_peered":"2024-08-17T02:27:25.456596+0000","last_clean":"2024-08-17T02:27:25.456596+0000","last_became_active":"2024-08-17T02:27:24.450804+0000","last_became_peered":"2024-08-17T02:27:24.450804+0000","last_unstale":"2024-08-17T02:27:25.456596+0000","last_undegraded":"2024-08-17T02:27:25.456596+0000","last_fullsized":"2024-08-17T02:27:25.456596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:51.057653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.453406+0000","last_change":"2024-08-17T02:27:25.446961+0000","last_active":"2024-08-17T02:27:25.453406+0000","last_peered":"2024-08-17T02:27:25.453406+0000","last_clean":"2024-08-17T02:27:25.453406+0000","last_became_active":"2024-08-17T02:27:25.446547+0000","last_became_peered":"2024-08-17T02:27:25.446547+0000","last_unstale":"2024-08-17T02:27:25.453406+0000","last_undegraded":"2024-08-17T02:27:25.453406+0000","last_fullsized":"2024-08-17T02:27:25.453406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:54.367077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.470520+0000","last_change":"2024-08-17T02:27:24.442678+0000","last_active":"2024-08-17T02:27:25.470520+0000","last_peered":"2024-08-17T02:27:25.470520+0000","last_clean":"2024-08-17T02:27:25.470520+0000","last_became_active":"2024-08-17T02:27:24.441192+0000","last_became_peered":"2024-08-17T02:27:24.441192+0000","last_unstale":"2024-08-17T02:27:25.470520+0000","last_undegraded":"2024-08-17T02:27:25.470520+0000","last_fullsized":"2024-08-17T02:27:25.470520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:04.447907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.465734+0000","last_change":"2024-08-17T02:27:25.459255+0000","last_active":"2024-08-17T02:27:25.465734+0000","last_peered":"2024-08-17T02:27:25.465734+0000","last_clean":"2024-08-17T02:27:25.465734+0000","last_became_active":"2024-08-17T02:27:25.458944+0000","last_became_peered":"2024-08-17T02:27:25.458944+0000","last_unstale":"2024-08-17T02:27:25.465734+0000","last_undegraded":"2024-08-17T02:27:25.465734+0000","last_fullsized":"2024-08-17T02:27:25.465734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:24.415210+0000","last_clean_scrub_stamp":"2024-08-17T02:27:24.415210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:52:26.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:25.464782+0000","last_change":"2024-08-17T02:27:24.450686+0000","last_active":"2024-08-17T02:27:25.464782+0000","last_peered":"2024-08-17T02:27:25.464782+0000","last_clean":"2024-08-17T02:27:25.464782+0000","last_became_active":"2024-08-17T02:27:24.450410+0000","last_became_peered":"2024-08-17T02:27:24.450410+0000","last_unstale":"2024-08-17T02:27:25.464782+0000","last_undegraded":"2024-08-17T02:27:25.464782+0000","last_fullsized":"2024-08-17T02:27:25.464782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:23.410289+0000","last_clean_scrub_stamp":"2024-08-17T02:27:23.410289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:41.154120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:35.099 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:27:35.099 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:27:35.099 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:27:35.099 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:27:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.282+0000 7f0059000640 1 Processor -- start 2024-08-17T02:27:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.283+0000 7f0059000640 1 -- start start 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0059000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00540aa8b0 0x7f00540af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0059000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f00540afe20 0x7f005415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0059000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005406dba0 con 0x7f00540aa4e0 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0059000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540aad30 con 0x7f00540afe20 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0059000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005415d580 con 0x7f00540aa8b0 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0053e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f00540afe20 0x7f005415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0053e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f00540afe20 0x7f005415c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43986/0 (socket says 172.21.15.42:43986) 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0053e00640 1 -- 172.21.15.42:0/3653789747 learned_addr learned my addr 172.21.15.42:0/3653789747 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.284+0000 7f0052a00640 1 --2- 172.21.15.42:0/3653789747 >> v2:172.21.15.62:3300/0 conn(0x7f00540aa8b0 0x7f00540af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.285+0000 7f0053e00640 1 -- 172.21.15.42:0/3653789747 >> v2:172.21.15.62:3300/0 conn(0x7f00540aa8b0 msgr2=0x7f00540af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.285+0000 7f0053e00640 1 --2- 172.21.15.42:0/3653789747 >> v2:172.21.15.62:3300/0 conn(0x7f00540aa8b0 0x7f00540af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.285+0000 7f0053e00640 1 -- 172.21.15.42:0/3653789747 >> v1:172.21.15.62:6789/0 conn(0x7f00540aa4e0 legacy=0x7f005406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.285+0000 7f0053e00640 1 -- 172.21.15.42:0/3653789747 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005406ddf0 con 0x7f00540afe20 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.286+0000 7f0053e00640 1 --2- 172.21.15.42:0/3653789747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540afe20 0x7f005415c810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f004c009f20 tx=0x7f004c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3e328171d641fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.286+0000 7f0052000640 1 -- 172.21.15.42:0/3653789747 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c033430 con 0x7f00540afe20 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.286+0000 7f0052000640 1 -- 172.21.15.42:0/3653789747 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c033590 con 0x7f00540afe20 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.286+0000 7f0052000640 1 -- 172.21.15.42:0/3653789747 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c033930 con 0x7f00540afe20 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.286+0000 7f0059000640 1 -- 172.21.15.42:0/3653789747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540afe20 msgr2=0x7f005415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.286+0000 7f0059000640 1 --2- 172.21.15.42:0/3653789747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540afe20 0x7f005415c810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f004c009f20 tx=0x7f004c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.287+0000 7f0059000640 1 -- 172.21.15.42:0/3653789747 shutdown_connections 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.287+0000 7f0059000640 1 --2- 172.21.15.42:0/3653789747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540afe20 0x7f005415c810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.287+0000 7f0059000640 1 --2- 172.21.15.42:0/3653789747 >> v2:172.21.15.62:3300/0 conn(0x7f00540aa8b0 0x7f00540af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.287+0000 7f0059000640 1 -- 172.21.15.42:0/3653789747 >> 172.21.15.42:0/3653789747 conn(0x7f0054066e60 msgr2=0x7f0054067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.287+0000 7f0059000640 1 -- 172.21.15.42:0/3653789747 shutdown_connections 2024-08-17T02:27:35.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.287+0000 7f0059000640 1 -- 172.21.15.42:0/3653789747 wait complete. 2024-08-17T02:27:35.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.288+0000 7f0059000640 1 Processor -- start 2024-08-17T02:27:35.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.288+0000 7f0059000640 1 -- start start 2024-08-17T02:27:35.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0059000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00540aa4e0 0x7f005415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0059000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 0x7f005413b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0059000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00540afe20 0x7f00541374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0059000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005415f590 con 0x7f00540aa8b0 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0059000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541388d0 con 0x7f00540afe20 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0059000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005415dfb0 con 0x7f00540aa4e0 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 0x7f005413b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 0x7f005413b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43996/0 (socket says 172.21.15.42:43996) 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 -- 172.21.15.42:0/3753861503 learned_addr learned my addr 172.21.15.42:0/3753861503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0053400640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00540aa4e0 0x7f005415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0053e00640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00540afe20 0x7f00541374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 -- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00540aa4e0 msgr2=0x7f005415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00540aa4e0 0x7f005415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 -- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00540afe20 msgr2=0x7f00541374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.289+0000 7f0052a00640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00540afe20 0x7f00541374d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f0052a00640 1 -- 172.21.15.42:0/3753861503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c009ae0 con 0x7f00540aa8b0 2024-08-17T02:27:35.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f0053400640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00540aa4e0 0x7f005415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:35.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f0053e00640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00540afe20 0x7f00541374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f0052a00640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 0x7f005413b670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f004000d890 tx=0x7f0040008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000de20 con 0x7f00540aa8b0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000b8d0 con 0x7f00540aa8b0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000bc70 con 0x7f00540aa8b0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005415e290 con 0x7f00540aa8b0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.290+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005415e850 con 0x7f00540aa8b0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.291+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0054070720 con 0x7f00540aa8b0 2024-08-17T02:27:35.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.292+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0040014640 con 0x7f00540aa8b0 2024-08-17T02:27:35.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.293+0000 7f004aa00640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0034065150 0x7f0034067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.293+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0040082b30 con 0x7f00540aa8b0 2024-08-17T02:27:35.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.293+0000 7f0053400640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0034065150 0x7f0034067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.294+0000 7f0053400640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0034065150 0x7f0034067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00440017a0 tx=0x7f0044009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.297+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0040050b50 con 0x7f00540aa8b0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.514+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f005406b1f0 con 0x7f00540aa8b0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.514+0000 7f004aa00640 1 -- 172.21.15.42:0/3753861503 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0040054170 con 0x7f00540aa8b0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0034065150 msgr2=0x7f0034067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0034065150 0x7f0034067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00440017a0 tx=0x7f0044009040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 msgr2=0x7f005413b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 0x7f005413b670 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f004000d890 tx=0x7f0040008040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 shutdown_connections 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0034065150 0x7f0034067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00540afe20 0x7f00541374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00540aa8b0 0x7f005413b670 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 --2- 172.21.15.42:0/3753861503 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00540aa4e0 0x7f005415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 >> 172.21.15.42:0/3753861503 conn(0x7f0054066e60 msgr2=0x7f005413f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 shutdown_connections 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.516+0000 7f0059000640 1 -- 172.21.15.42:0/3753861503 wait complete. 2024-08-17T02:27:35.532 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:27:35.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:35.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.683+0000 7f3d09400640 1 Processor -- start 2024-08-17T02:27:35.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.683+0000 7f3d09400640 1 -- start start 2024-08-17T02:27:35.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.684+0000 7f3d09400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3d040b1860 0x7f3d04069c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.684+0000 7f3d09400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d0406a360 0x7f3d04157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.684+0000 7f3d09400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d04157590 con 0x7f3d040aae60 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.684+0000 7f3d09400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0406b3a0 con 0x7f3d040b1860 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.684+0000 7f3d09400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0406ab00 con 0x7f3d0406a360 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d02800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3d040aae60 0x7f3d040b1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56636/0 (socket says 172.21.15.42:56636) 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d02800640 1 -- 172.21.15.42:0/2350241866 learned_addr learned my addr 172.21.15.42:0/2350241866 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d01e00640 1 --2- 172.21.15.42:0/2350241866 >> v2:172.21.15.62:3300/0 conn(0x7f3d040b1860 0x7f3d04069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d03200640 1 --2- 172.21.15.42:0/2350241866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d0406a360 0x7f3d04157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d01400640 1 -- 172.21.15.42:0/2350241866 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352703570 0 0) 0x7f3d04157590 con 0x7f3d040aae60 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d01400640 1 -- 172.21.15.42:0/2350241866 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce80034e0 con 0x7f3d040aae60 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d03200640 1 -- 172.21.15.42:0/2350241866 >> v2:172.21.15.62:3300/0 conn(0x7f3d040b1860 msgr2=0x7f3d04069c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d03200640 1 --2- 172.21.15.42:0/2350241866 >> v2:172.21.15.62:3300/0 conn(0x7f3d040b1860 0x7f3d04069c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d03200640 1 -- 172.21.15.42:0/2350241866 >> v1:172.21.15.42:6789/0 conn(0x7f3d040aae60 legacy=0x7f3d040b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.685+0000 7f3d03200640 1 -- 172.21.15.42:0/2350241866 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0406ade0 con 0x7f3d0406a360 2024-08-17T02:27:35.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.687+0000 7f3d03200640 1 --2- 172.21.15.42:0/2350241866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d0406a360 0x7f3d04157a20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009e90 tx=0x7f3cfc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ddfa9e5f6d5aa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.687+0000 7f3d01400640 1 -- 172.21.15.42:0/2350241866 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc007550 con 0x7f3d0406a360 2024-08-17T02:27:35.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.687+0000 7f3d01400640 1 -- 172.21.15.42:0/2350241866 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc02d050 con 0x7f3d0406a360 2024-08-17T02:27:35.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.687+0000 7f3d01400640 1 -- 172.21.15.42:0/2350241866 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc007900 con 0x7f3d0406a360 2024-08-17T02:27:35.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 -- 172.21.15.42:0/2350241866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d0406a360 msgr2=0x7f3d04157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 --2- 172.21.15.42:0/2350241866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d0406a360 0x7f3d04157a20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009e90 tx=0x7f3cfc009780 comp rx=0 tx=0).stop 2024-08-17T02:27:35.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 -- 172.21.15.42:0/2350241866 shutdown_connections 2024-08-17T02:27:35.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 --2- 172.21.15.42:0/2350241866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d0406a360 0x7f3d04157a20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 --2- 172.21.15.42:0/2350241866 >> v2:172.21.15.62:3300/0 conn(0x7f3d040b1860 0x7f3d04069c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 -- 172.21.15.42:0/2350241866 >> 172.21.15.42:0/2350241866 conn(0x7f3d04066e60 msgr2=0x7f3d04067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 -- 172.21.15.42:0/2350241866 shutdown_connections 2024-08-17T02:27:35.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.688+0000 7f3d09400640 1 -- 172.21.15.42:0/2350241866 wait complete. 2024-08-17T02:27:35.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.689+0000 7f3d09400640 1 Processor -- start 2024-08-17T02:27:35.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.689+0000 7f3d09400640 1 -- start start 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d09400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0406a360 0x7f3d04151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d09400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d040aae60 0x7f3d04151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d09400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 0x7f3d0416a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d09400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d041411f0 con 0x7f3d040b1860 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d09400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04144210 con 0x7f3d0406a360 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d09400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d04143600 con 0x7f3d040aae60 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d03200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 0x7f3d0416a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d03200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 0x7f3d0416a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44008/0 (socket says 172.21.15.42:44008) 2024-08-17T02:27:35.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d03200640 1 -- 172.21.15.42:0/275672793 learned_addr learned my addr 172.21.15.42:0/275672793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d01e00640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d040aae60 0x7f3d04151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.690+0000 7f3d02800640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0406a360 0x7f3d04151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d01e00640 1 -- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0406a360 msgr2=0x7f3d04151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d01e00640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0406a360 0x7f3d04151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d01e00640 1 -- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 msgr2=0x7f3d0416a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d01e00640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 0x7f3d0416a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d01e00640 1 -- 172.21.15.42:0/275672793 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc009a20 con 0x7f3d040aae60 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d03200640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 0x7f3d0416a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d01e00640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d040aae60 0x7f3d04151fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d0406a190 tx=0x7f3cf00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000c730 con 0x7f3d040aae60 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000c890 con 0x7f3d040aae60 2024-08-17T02:27:35.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d041438e0 con 0x7f3d040aae60 2024-08-17T02:27:35.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.691+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000cc30 con 0x7f3d040aae60 2024-08-17T02:27:35.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.692+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d04143ea0 con 0x7f3d040aae60 2024-08-17T02:27:35.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.693+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d04063fb0 con 0x7f3d040aae60 2024-08-17T02:27:35.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.693+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3cf0013470 con 0x7f3d040aae60 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.694+0000 7f3cfa000640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3ce4065150 0x7f3ce4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.695+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3cf00824c0 con 0x7f3d040aae60 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.695+0000 7f3d02800640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3ce4065150 0x7f3ce4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.695+0000 7f3d02800640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3ce4065150 0x7f3ce4067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4005840 tx=0x7f3cf4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.699+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3cf0050590 con 0x7f3d040aae60 2024-08-17T02:27:35.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.886+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d04144350 con 0x7f3d040aae60 2024-08-17T02:27:35.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.888+0000 7f3cfa000640 1 -- 172.21.15.42:0/275672793 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3cf0053bb0 con 0x7f3d040aae60 2024-08-17T02:27:35.888 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:35.888 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.889+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3ce4065150 msgr2=0x7f3ce4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.889+0000 7f3d09400640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3ce4065150 0x7f3ce4067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4005840 tx=0x7f3cf4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.889+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d040aae60 msgr2=0x7f3d04151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.889+0000 7f3d09400640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d040aae60 0x7f3d04151fc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d0406a190 tx=0x7f3cf00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 shutdown_connections 2024-08-17T02:27:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3ce4065150 0x7f3ce4067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d040b1860 0x7f3d0416a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d040aae60 0x7f3d04151fc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 --2- 172.21.15.42:0/275672793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d0406a360 0x7f3d04151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 >> 172.21.15.42:0/275672793 conn(0x7f3d04066e60 msgr2=0x7f3d0406dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 shutdown_connections 2024-08-17T02:27:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:35.890+0000 7f3d09400640 1 -- 172.21.15.42:0/275672793 wait complete. 2024-08-17T02:27:35.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:35.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:36.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.059+0000 7f4636e00640 1 Processor -- start 2024-08-17T02:27:36.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.059+0000 7f4636e00640 1 -- start start 2024-08-17T02:27:36.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.060+0000 7f4636e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300ca080 0x7f46300b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.060+0000 7f4636e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300c8be0 con 0x7f46300afef0 2024-08-17T02:27:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.060+0000 7f4636e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300af440 con 0x7f46300aef70 2024-08-17T02:27:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.060+0000 7f4636e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300ad880 con 0x7f46300ca080 2024-08-17T02:27:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f462fe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f46300afef0 0x7f46300ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56640/0 (socket says 172.21.15.42:56640) 2024-08-17T02:27:36.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f462fe00640 1 -- 172.21.15.42:0/3459753435 learned_addr learned my addr 172.21.15.42:0/3459753435 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f4634e00640 1 --2- 172.21.15.42:0/3459753435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300ca080 0x7f46300b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253676930 0 0) 0x7f46300c8be0 con 0x7f46300afef0 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46140034e0 con 0x7f46300afef0 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075071546 0 0) 0x7f46300af440 con 0x7f46300aef70 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46300c8be0 con 0x7f46300aef70 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f4634e00640 1 -- 172.21.15.42:0/3459753435 >> v1:172.21.15.62:6789/0 conn(0x7f46300aef70 legacy=0x7f4630154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f4634e00640 1 -- 172.21.15.42:0/3459753435 >> v1:172.21.15.42:6789/0 conn(0x7f46300afef0 legacy=0x7f46300ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.061+0000 7f4634e00640 1 -- 172.21.15.42:0/3459753435 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300af720 con 0x7f46300ca080 2024-08-17T02:27:36.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.062+0000 7f4634e00640 1 --2- 172.21.15.42:0/3459753435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300ca080 0x7f46300b02c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4628009e90 tx=0x7f4628009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=469dd8fa2fa9f54c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628007550 con 0x7f46300ca080 2024-08-17T02:27:36.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462802d050 con 0x7f46300ca080 2024-08-17T02:27:36.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f462f400640 1 -- 172.21.15.42:0/3459753435 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280078e0 con 0x7f46300ca080 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 -- 172.21.15.42:0/3459753435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300ca080 msgr2=0x7f46300b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 --2- 172.21.15.42:0/3459753435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300ca080 0x7f46300b02c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4628009e90 tx=0x7f4628009780 comp rx=0 tx=0).stop 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 -- 172.21.15.42:0/3459753435 shutdown_connections 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 --2- 172.21.15.42:0/3459753435 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300ca080 0x7f46300b02c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 -- 172.21.15.42:0/3459753435 >> 172.21.15.42:0/3459753435 conn(0x7f46300cc390 msgr2=0x7f4630066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 -- 172.21.15.42:0/3459753435 shutdown_connections 2024-08-17T02:27:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.063+0000 7f4636e00640 1 -- 172.21.15.42:0/3459753435 wait complete. 2024-08-17T02:27:36.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.065+0000 7f4636e00640 1 Processor -- start 2024-08-17T02:27:36.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.065+0000 7f4636e00640 1 -- start start 2024-08-17T02:27:36.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4636e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300aef70 0x7f463014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4636e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 0x7f4630149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4636e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46300ca080 0x7f4630147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4636e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463014efd0 con 0x7f46300afef0 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4636e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630159ce0 con 0x7f46300ca080 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4636e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4630159a00 con 0x7f46300aef70 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 0x7f4630149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 0x7f4630149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44018/0 (socket says 172.21.15.42:44018) 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 -- 172.21.15.42:0/360642346 learned_addr learned my addr 172.21.15.42:0/360642346 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f462fe00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300aef70 0x7f463014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 -- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300aef70 msgr2=0x7f463014f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300aef70 0x7f463014f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4634e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46300ca080 0x7f4630147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 -- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46300ca080 msgr2=0x7f4630147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46300ca080 0x7f4630147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f4627400640 1 -- 172.21.15.42:0/360642346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009a20 con 0x7f46300afef0 2024-08-17T02:27:36.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.066+0000 7f462fe00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300aef70 0x7f463014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:36.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.067+0000 7f4627400640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 0x7f4630149fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f461800c590 tx=0x7f4618007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.067+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618012630 con 0x7f46300afef0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.067+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46180127b0 con 0x7f46300afef0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.067+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618012bb0 con 0x7f46300afef0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.067+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463014e980 con 0x7f46300afef0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.067+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463014a500 con 0x7f46300afef0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.068+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463014f180 con 0x7f46300afef0 2024-08-17T02:27:36.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.069+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f461801a3b0 con 0x7f46300afef0 2024-08-17T02:27:36.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.070+0000 7f4627e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f460c065150 0x7f460c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.070+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4618082490 con 0x7f46300afef0 2024-08-17T02:27:36.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.070+0000 7f462fe00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f460c065150 0x7f460c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.070+0000 7f462fe00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f460c065150 0x7f460c067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4620007fd0 tx=0x7f4620009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.073+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f463014f180 con 0x7f46300afef0 2024-08-17T02:27:36.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.252+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f463014f180 con 0x7f46300afef0 2024-08-17T02:27:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.253+0000 7f4627e00640 1 -- 172.21.15.42:0/360642346 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f463014f180 con 0x7f46300afef0 2024-08-17T02:27:36.253 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f460c065150 msgr2=0x7f460c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f460c065150 0x7f460c067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4620007fd0 tx=0x7f4620009040 comp rx=0 tx=0).stop 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 msgr2=0x7f4630149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 0x7f4630149fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f461800c590 tx=0x7f4618007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 shutdown_connections 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f460c065150 0x7f460c067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46300ca080 0x7f4630147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46300afef0 0x7f4630149fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 --2- 172.21.15.42:0/360642346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46300aef70 0x7f463014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 >> 172.21.15.42:0/360642346 conn(0x7f46300cc390 msgr2=0x7f46300ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 shutdown_connections 2024-08-17T02:27:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.255+0000 7f4636e00640 1 -- 172.21.15.42:0/360642346 wait complete. 2024-08-17T02:27:36.270 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:36.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.424+0000 7f56e1400640 1 Processor -- start 2024-08-17T02:27:36.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.424+0000 7f56e1400640 1 -- start start 2024-08-17T02:27:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56e1400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56dc0b1850 0x7f56dc0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56e1400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f56dc1585a0 0x7f56dc1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56e1400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0ce770 con 0x7f56dc0d0650 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56e1400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc0ce9b0 con 0x7f56dc1585a0 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56e1400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc0cec90 con 0x7f56dc0b1850 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56dbe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56dc0b1850 0x7f56dc0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56dbe00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56dc0b1850 0x7f56dc0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41404/0 (socket says 172.21.15.42:41404) 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56d3e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f56dc0d0650 0x7f56dc0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56650/0 (socket says 172.21.15.42:56650) 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56dbe00640 1 -- 172.21.15.42:0/2792193875 learned_addr learned my addr 172.21.15.42:0/2792193875 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.425+0000 7f56e0a00640 1 --2- 172.21.15.42:0/2792193875 >> v2:172.21.15.42:3300/0 conn(0x7f56dc1585a0 0x7f56dc1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.426+0000 7f56dbe00640 1 -- 172.21.15.42:0/2792193875 >> v2:172.21.15.42:3300/0 conn(0x7f56dc1585a0 msgr2=0x7f56dc1589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.426+0000 7f56dbe00640 1 --2- 172.21.15.42:0/2792193875 >> v2:172.21.15.42:3300/0 conn(0x7f56dc1585a0 0x7f56dc1589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.426+0000 7f56dbe00640 1 -- 172.21.15.42:0/2792193875 >> v1:172.21.15.42:6789/0 conn(0x7f56dc0d0650 legacy=0x7f56dc0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.426+0000 7f56dbe00640 1 -- 172.21.15.42:0/2792193875 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0cef70 con 0x7f56dc0b1850 2024-08-17T02:27:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.426+0000 7f56db400640 1 -- 172.21.15.42:0/2792193875 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152861646 0 0) 0x7f56c4001110 con 0x7f56dc0d0650 2024-08-17T02:27:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.427+0000 7f56dbe00640 1 --2- 172.21.15.42:0/2792193875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0b1c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56dc088960 tx=0x7f56cc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3d6ce8627fe822 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.427+0000 7f56db400640 1 -- 172.21.15.42:0/2792193875 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc02ae80 con 0x7f56dc0b1850 2024-08-17T02:27:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.427+0000 7f56db400640 1 -- 172.21.15.42:0/2792193875 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc032440 con 0x7f56dc0b1850 2024-08-17T02:27:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.427+0000 7f56db400640 1 -- 172.21.15.42:0/2792193875 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0327c0 con 0x7f56dc0b1850 2024-08-17T02:27:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 -- 172.21.15.42:0/2792193875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 msgr2=0x7f56dc0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 --2- 172.21.15.42:0/2792193875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0b1c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56dc088960 tx=0x7f56cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 -- 172.21.15.42:0/2792193875 shutdown_connections 2024-08-17T02:27:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 --2- 172.21.15.42:0/2792193875 >> v2:172.21.15.42:3300/0 conn(0x7f56dc1585a0 0x7f56dc1589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 --2- 172.21.15.42:0/2792193875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0b1c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 -- 172.21.15.42:0/2792193875 >> 172.21.15.42:0/2792193875 conn(0x7f56dc06e590 msgr2=0x7f56dc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 -- 172.21.15.42:0/2792193875 shutdown_connections 2024-08-17T02:27:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.428+0000 7f56e1400640 1 -- 172.21.15.42:0/2792193875 wait complete. 2024-08-17T02:27:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.429+0000 7f56e1400640 1 Processor -- start 2024-08-17T02:27:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.429+0000 7f56e1400640 1 -- start start 2024-08-17T02:27:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.430+0000 7f56e1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.430+0000 7f56e1400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56dc0d0650 0x7f56dc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.430+0000 7f56e1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 0x7f56dc0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.430+0000 7f56e1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0aaee0 con 0x7f56dc1585a0 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.430+0000 7f56e1400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0ab1c0 con 0x7f56dc0b1850 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.430+0000 7f56e1400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0ab4a0 con 0x7f56dc0d0650 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 0x7f56dc0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56dbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 0x7f56dc0afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44032/0 (socket says 172.21.15.42:44032) 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 -- 172.21.15.42:0/1564061882 learned_addr learned my addr 172.21.15.42:0/1564061882 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56dbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:41418/0 (socket says 172.21.15.42:41418) 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56d3e00640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56dc0d0650 0x7f56dc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 -- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56dc0d0650 msgr2=0x7f56dc1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56dc0d0650 0x7f56dc1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 -- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 msgr2=0x7f56dc0aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 -- 172.21.15.42:0/1564061882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc009450 con 0x7f56dc1585a0 2024-08-17T02:27:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56e0a00640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 0x7f56dc0afdf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009df0 tx=0x7f56d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.431+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400cd40 con 0x7f56dc1585a0 2024-08-17T02:27:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.432+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d400f040 con 0x7f56dc1585a0 2024-08-17T02:27:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.432+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d40146d0 con 0x7f56dc1585a0 2024-08-17T02:27:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.432+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc169350 con 0x7f56dc1585a0 2024-08-17T02:27:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.432+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc0aabd0 con 0x7f56dc1585a0 2024-08-17T02:27:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.433+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc169540 con 0x7f56dc1585a0 2024-08-17T02:27:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.434+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f56d4014a80 con 0x7f56dc1585a0 2024-08-17T02:27:36.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.434+0000 7f56d3400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f56b8065150 0x7f56b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.434+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f56d40830c0 con 0x7f56dc1585a0 2024-08-17T02:27:36.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.435+0000 7f56dbe00640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f56b8065150 0x7f56b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.435+0000 7f56dbe00640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f56b8065150 0x7f56b8067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56cc034000 tx=0x7f56cc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.439+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f56d4051190 con 0x7f56dc1585a0 2024-08-17T02:27:36.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.620+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56dc070720 con 0x7f56dc1585a0 2024-08-17T02:27:36.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.621+0000 7f56d3400640 1 -- 172.21.15.42:0/1564061882 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56d40547b0 con 0x7f56dc1585a0 2024-08-17T02:27:36.621 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f56b8065150 msgr2=0x7f56b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f56b8065150 0x7f56b8067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56cc034000 tx=0x7f56cc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 msgr2=0x7f56dc0afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 0x7f56dc0afdf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009df0 tx=0x7f56d400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 shutdown_connections 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f56b8065150 0x7f56b8067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc1585a0 0x7f56dc0afdf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f56dc0d0650 0x7f56dc1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 --2- 172.21.15.42:0/1564061882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56dc0b1850 0x7f56dc0aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 >> 172.21.15.42:0/1564061882 conn(0x7f56dc06e590 msgr2=0x7f56dc0acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 shutdown_connections 2024-08-17T02:27:36.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.623+0000 7f56e1400640 1 -- 172.21.15.42:0/1564061882 wait complete. 2024-08-17T02:27:36.637 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:36.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.791+0000 7facefa00640 1 Processor -- start 2024-08-17T02:27:36.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.791+0000 7facefa00640 1 -- start start 2024-08-17T02:27:36.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.792+0000 7facefa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7face80ca050 0x7face8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.792+0000 7facefa00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80cb160 con 0x7face80ad960 2024-08-17T02:27:36.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.792+0000 7facefa00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80b0d10 con 0x7face80add30 2024-08-17T02:27:36.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.792+0000 7facefa00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80ca550 con 0x7face80ca050 2024-08-17T02:27:36.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.792+0000 7faced000640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7face80ad960 0x7face8156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56658/0 (socket says 172.21.15.42:56658) 2024-08-17T02:27:36.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.792+0000 7faced000640 1 -- 172.21.15.42:0/4077150602 learned_addr learned my addr 172.21.15.42:0/4077150602 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:36.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7e00640 1 --2- 172.21.15.42:0/4077150602 >> v2:172.21.15.62:3300/0 conn(0x7face80ca050 0x7face8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159136512 0 0) 0x7face80cb160 con 0x7face80ad960 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd00034e0 con 0x7face80ad960 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635247893 0 0) 0x7face80b0d10 con 0x7face80add30 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face80cb160 con 0x7face80add30 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377433330 0 0) 0x7facd00034e0 con 0x7face80ad960 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 >> v2:172.21.15.62:3300/0 conn(0x7face80ca050 msgr2=0x7face8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 --2- 172.21.15.42:0/4077150602 >> v2:172.21.15.62:3300/0 conn(0x7face80ca050 0x7face8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 >> v1:172.21.15.62:6789/0 conn(0x7face80add30 legacy=0x7face80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80ca830 con 0x7face80ad960 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7facdc001470 con 0x7face80ad960 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 >> v1:172.21.15.42:6789/0 conn(0x7face80ad960 legacy=0x7face8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facd0003b60 0x7facd0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7facd0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facd0005130 0x7facd000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80ca550 con 0x7facd0004780 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd000c020 con 0x7facd0003b60 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd000c1e0 con 0x7facd0005130 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7face7e00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7facd0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.793+0000 7faced000640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facd0003b60 0x7facd0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7faceda00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facd0005130 0x7facd000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7face7e00640 1 -- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facd0005130 msgr2=0x7facd000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7face7e00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facd0005130 0x7facd000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7face7e00640 1 -- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facd0003b60 msgr2=0x7facd0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7face7e00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7facd0003b60 0x7facd0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7face7e00640 1 -- 172.21.15.42:0/4077150602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00034e0 con 0x7facd0004780 2024-08-17T02:27:36.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7faceda00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7facd0005130 0x7facd000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:36.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.794+0000 7faceda00640 1 -- 172.21.15.42:0/4077150602 reap_dead start 2024-08-17T02:27:36.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.795+0000 7face7e00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7facd0004bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7facd4009b70 tx=0x7facd40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87b76bf0179acd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.795+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4031400 con 0x7facd0004780 2024-08-17T02:27:36.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.795+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd402d050 con 0x7facd0004780 2024-08-17T02:27:36.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.795+0000 7face7400640 1 -- 172.21.15.42:0/4077150602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4031790 con 0x7facd0004780 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.795+0000 7facefa00640 1 -- 172.21.15.42:0/4077150602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 msgr2=0x7facd0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.795+0000 7facefa00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7facd0004bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7facd4009b70 tx=0x7facd40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.796+0000 7facefa00640 1 -- 172.21.15.42:0/4077150602 shutdown_connections 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.796+0000 7facefa00640 1 --2- 172.21.15.42:0/4077150602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7facd0004bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.796+0000 7facefa00640 1 -- 172.21.15.42:0/4077150602 >> 172.21.15.42:0/4077150602 conn(0x7face8066e60 msgr2=0x7face8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.796+0000 7facefa00640 1 -- 172.21.15.42:0/4077150602 shutdown_connections 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.796+0000 7facefa00640 1 -- 172.21.15.42:0/4077150602 wait complete. 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.797+0000 7facefa00640 1 Processor -- start 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.797+0000 7facefa00640 1 -- start start 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7facefa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7face80abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7facefa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7face8169b70 0x7face81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7facefa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80a97e0 0x7face80a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7facefa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80aa190 con 0x7facd0004780 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7facefa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80acf30 con 0x7face80a97e0 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7facefa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80ac320 con 0x7face8169b70 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7faced000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7face80abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7faced000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7face80abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44046/0 (socket says 172.21.15.42:44046) 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7faced000640 1 -- 172.21.15.42:0/4236225950 learned_addr learned my addr 172.21.15.42:0/4236225950 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7face7e00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7face8169b70 0x7face81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.798+0000 7faceda00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80a97e0 0x7face80a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faced000640 1 -- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7face8169b70 msgr2=0x7face81513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faced000640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7face8169b70 0x7face81513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faced000640 1 -- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80a97e0 msgr2=0x7face80a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faced000640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80a97e0 0x7face80a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faced000640 1 -- 172.21.15.42:0/4236225950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80ac600 con 0x7facd0004780 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faceda00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80a97e0 0x7face80a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:36.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7faced000640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7face80abcb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7facdc004b00 tx=0x7facdc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc018030 con 0x7facd0004780 2024-08-17T02:27:36.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc00f9c0 con 0x7facd0004780 2024-08-17T02:27:36.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc00fd80 con 0x7facd0004780 2024-08-17T02:27:36.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80ac8e0 con 0x7facd0004780 2024-08-17T02:27:36.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.799+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face8169fe0 con 0x7facd0004780 2024-08-17T02:27:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.800+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8063fb0 con 0x7facd0004780 2024-08-17T02:27:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.801+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7facdc01b070 con 0x7facd0004780 2024-08-17T02:27:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.802+0000 7facdbe00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7facc8065180 0x7facc8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.802+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7facdc019070 con 0x7facd0004780 2024-08-17T02:27:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.802+0000 7face7e00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7facc8065180 0x7facc8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.803+0000 7face7e00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7facc8065180 0x7facc8067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facd4034000 tx=0x7facd4035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.806+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7facdc0503e0 con 0x7facd0004780 2024-08-17T02:27:36.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.993+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7face80c8860 con 0x7facd0004780 2024-08-17T02:27:36.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.993+0000 7facdbe00640 1 -- 172.21.15.42:0/4236225950 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7facdc053a00 con 0x7facd0004780 2024-08-17T02:27:36.993 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7facc8065180 msgr2=0x7facc8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7facc8065180 0x7facc8067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facd4034000 tx=0x7facd4035000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 msgr2=0x7face80abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7face80abcb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7facdc004b00 tx=0x7facdc001e10 comp rx=0 tx=0).stop 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 shutdown_connections 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7facc8065180 0x7facc8067630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7face80a97e0 0x7face80a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7face8169b70 0x7face81513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 --2- 172.21.15.42:0/4236225950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facd0004780 0x7face80abcb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 >> 172.21.15.42:0/4236225950 conn(0x7face8066e60 msgr2=0x7face80aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 shutdown_connections 2024-08-17T02:27:36.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:36.995+0000 7facefa00640 1 -- 172.21.15.42:0/4236225950 wait complete. 2024-08-17T02:27:37.010 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:37.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.161+0000 7fa8fb200640 1 Processor -- start 2024-08-17T02:27:37.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.161+0000 7fa8fb200640 1 -- start start 2024-08-17T02:27:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.162+0000 7fa8fb200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8f4155040 0x7fa8f4158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.162+0000 7fa8fb200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa8f406e770 0x7fa8f40af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8fb200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f40aeeb0 con 0x7fa8f41591c0 2024-08-17T02:27:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8fb200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f4159610 con 0x7fa8f406e770 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8fb200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f40aadd0 con 0x7fa8f4155040 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa8f406e770 0x7fa8f40af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa8f406e770 0x7fa8f40af340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44050/0 (socket says 172.21.15.42:44050) 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 -- 172.21.15.42:0/115070205 learned_addr learned my addr 172.21.15.42:0/115070205 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f3e00640 1 --2- 172.21.15.42:0/115070205 >> v2:172.21.15.62:3300/0 conn(0x7fa8f4155040 0x7fa8f4158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 -- 172.21.15.42:0/115070205 >> v2:172.21.15.62:3300/0 conn(0x7fa8f4155040 msgr2=0x7fa8f4158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 --2- 172.21.15.42:0/115070205 >> v2:172.21.15.62:3300/0 conn(0x7fa8f4155040 0x7fa8f4158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 -- 172.21.15.42:0/115070205 >> v1:172.21.15.62:6789/0 conn(0x7fa8f41591c0 legacy=0x7fa8f406e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.163+0000 7fa8f9200640 1 -- 172.21.15.42:0/115070205 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f41597f0 con 0x7fa8f406e770 2024-08-17T02:27:37.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.164+0000 7fa8f9200640 1 --2- 172.21.15.42:0/115070205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40af340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8f406c660 tx=0x7fa8ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619164469a58bc34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.164+0000 7fa8f3400640 1 -- 172.21.15.42:0/115070205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec031400 con 0x7fa8f406e770 2024-08-17T02:27:37.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8f3400640 1 -- 172.21.15.42:0/115070205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec02d050 con 0x7fa8f406e770 2024-08-17T02:27:37.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8f3400640 1 -- 172.21.15.42:0/115070205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0317d0 con 0x7fa8f406e770 2024-08-17T02:27:37.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 -- 172.21.15.42:0/115070205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 msgr2=0x7fa8f40af340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 --2- 172.21.15.42:0/115070205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40af340 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8f406c660 tx=0x7fa8ec009840 comp rx=0 tx=0).stop 2024-08-17T02:27:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 -- 172.21.15.42:0/115070205 shutdown_connections 2024-08-17T02:27:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 --2- 172.21.15.42:0/115070205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40af340 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 --2- 172.21.15.42:0/115070205 >> v2:172.21.15.62:3300/0 conn(0x7fa8f4155040 0x7fa8f4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 -- 172.21.15.42:0/115070205 >> 172.21.15.42:0/115070205 conn(0x7fa8f4066e60 msgr2=0x7fa8f4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 -- 172.21.15.42:0/115070205 shutdown_connections 2024-08-17T02:27:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.165+0000 7fa8fb200640 1 -- 172.21.15.42:0/115070205 wait complete. 2024-08-17T02:27:37.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.166+0000 7fa8fb200640 1 Processor -- start 2024-08-17T02:27:37.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.167+0000 7fa8fb200640 1 -- start start 2024-08-17T02:27:37.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8fb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8fb200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f4155040 0x7fa8f40c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8fb200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8f41591c0 0x7fa8f40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8fb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4151d70 con 0x7fa8f406e770 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8fb200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4168e50 con 0x7fa8f4155040 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8fb200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f4156140 con 0x7fa8f41591c0 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44058/0 (socket says 172.21.15.42:44058) 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 -- 172.21.15.42:0/926417672 learned_addr learned my addr 172.21.15.42:0/926417672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f9200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8f41591c0 0x7fa8f40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8eb400640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f4155040 0x7fa8f40c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 -- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8f41591c0 msgr2=0x7fa8f40c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8f41591c0 0x7fa8f40c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 -- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f4155040 msgr2=0x7fa8f40c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f4155040 0x7fa8f40c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 -- 172.21.15.42:0/926417672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec009ae0 con 0x7fa8f406e770 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8eb400640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f4155040 0x7fa8f40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f9200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8f41591c0 0x7fa8f40c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.168+0000 7fa8f3e00640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40c7100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400d8c0 tx=0x7fa8e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.169+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400de50 con 0x7fa8f406e770 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.169+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e400b8d0 con 0x7fa8f406e770 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.169+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400bc90 con 0x7fa8f406e770 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.169+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f4156420 con 0x7fa8f406e770 2024-08-17T02:27:37.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.169+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f41569e0 con 0x7fa8f406e770 2024-08-17T02:27:37.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.170+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f4169020 con 0x7fa8f406e770 2024-08-17T02:27:37.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.171+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa8e401e460 con 0x7fa8f406e770 2024-08-17T02:27:37.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.171+0000 7fa8ebe00640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa8d0065150 0x7fa8d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.172+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8e4082b80 con 0x7fa8f406e770 2024-08-17T02:27:37.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.172+0000 7fa8eb400640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa8d0065150 0x7fa8d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.172+0000 7fa8eb400640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa8d0065150 0x7fa8d0067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ca4f0 tx=0x7fa8dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.175+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa8f4169020 con 0x7fa8f406e770 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.393+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8f4169020 con 0x7fa8f406e770 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.393+0000 7fa8ebe00640 1 -- 172.21.15.42:0/926417672 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fa8f4169020 con 0x7fa8f406e770 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.395+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa8d0065150 msgr2=0x7fa8d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.395+0000 7fa8fb200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa8d0065150 0x7fa8d0067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ca4f0 tx=0x7fa8dc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.395+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 msgr2=0x7fa8f40c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.395+0000 7fa8fb200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40c7100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400d8c0 tx=0x7fa8e4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 shutdown_connections 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa8d0065150 0x7fa8d0067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8f41591c0 0x7fa8f40c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8f4155040 0x7fa8f40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 --2- 172.21.15.42:0/926417672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f406e770 0x7fa8f40c7100 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 >> 172.21.15.42:0/926417672 conn(0x7fa8f4066e60 msgr2=0x7fa8f40c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 shutdown_connections 2024-08-17T02:27:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.396+0000 7fa8fb200640 1 -- 172.21.15.42:0/926417672 wait complete. 2024-08-17T02:27:37.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:37.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.562+0000 7fa3f1a00640 1 Processor -- start 2024-08-17T02:27:37.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.562+0000 7fa3f1a00640 1 -- start start 2024-08-17T02:27:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3f1a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa3ec159120 0x7fa3ec0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3f1a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3ec0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3f1a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0a96c0 con 0x7fa3ec158d50 2024-08-17T02:27:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3f1a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0ac270 con 0x7fa3ec159120 2024-08-17T02:27:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3f1a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0acf00 con 0x7fa3ec0abe30 2024-08-17T02:27:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3eaa00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa3ec158d50 0x7fa3ec0ac4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56666/0 (socket says 172.21.15.42:56666) 2024-08-17T02:27:37.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.563+0000 7fa3eaa00640 1 -- 172.21.15.42:0/4201941819 learned_addr learned my addr 172.21.15.42:0/4201941819 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3ea000640 1 --2- 172.21.15.42:0/4201941819 >> v2:172.21.15.62:3300/0 conn(0x7fa3ec159120 0x7fa3ec0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3eb400640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3ec0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723711075 0 0) 0x7fa3ec0a96c0 con 0x7fa3ec158d50 2024-08-17T02:27:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d00034e0 con 0x7fa3ec158d50 2024-08-17T02:27:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3127846771 0 0) 0x7fa3d00034e0 con 0x7fa3ec158d50 2024-08-17T02:27:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 msgr2=0x7fa3ec0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3ec0aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 >> v2:172.21.15.62:3300/0 conn(0x7fa3ec159120 msgr2=0x7fa3ec0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 --2- 172.21.15.42:0/4201941819 >> v2:172.21.15.62:3300/0 conn(0x7fa3ec159120 0x7fa3ec0ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0af7d0 con 0x7fa3ec158d50 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fa3dc001470 con 0x7fa3ec158d50 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 >> v1:172.21.15.42:6789/0 conn(0x7fa3ec158d50 legacy=0x7fa3ec0ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3d0004780 0x7fa3d0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3d0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0ac270 con 0x7fa3d0004780 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0acf00 con 0x7fa3d00039d0 2024-08-17T02:27:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.564+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d000b9d0 con 0x7fa3ec0abe30 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3ea000640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3d0004780 0x7fa3d0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3eaa00640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3eb400640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3d0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3ea000640 1 -- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 msgr2=0x7fa3d0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3ea000640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3d0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3ea000640 1 -- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3d00039d0 msgr2=0x7fa3d0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3ea000640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3ea000640 1 -- 172.21.15.42:0/4201941819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d00034e0 con 0x7fa3d0004780 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3eb400640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3ec0abe30 0x7fa3d0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.565+0000 7fa3eaa00640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3d00039d0 0x7fa3d0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.566+0000 7fa3ea000640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3d0004780 0x7fa3d0004bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ba0 tx=0x7fa3d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339db0171cb163e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.566+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8031400 con 0x7fa3d0004780 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.566+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d802d050 con 0x7fa3d0004780 2024-08-17T02:27:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.566+0000 7fa3e9600640 1 -- 172.21.15.42:0/4201941819 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8031790 con 0x7fa3d0004780 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3f1a00640 1 -- 172.21.15.42:0/4201941819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3d0004780 msgr2=0x7fa3d0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/4201941819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3d0004780 0x7fa3d0004bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ba0 tx=0x7fa3d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3eb400640 1 -- 172.21.15.42:0/4201941819 reap_dead start 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3f1a00640 1 -- 172.21.15.42:0/4201941819 shutdown_connections 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3f1a00640 1 -- 172.21.15.42:0/4201941819 >> 172.21.15.42:0/4201941819 conn(0x7fa3ec095a70 msgr2=0x7fa3ec095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3f1a00640 1 -- 172.21.15.42:0/4201941819 shutdown_connections 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.567+0000 7fa3f1a00640 1 -- 172.21.15.42:0/4201941819 wait complete. 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.568+0000 7fa3f1a00640 1 Processor -- start 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.568+0000 7fa3f1a00640 1 -- start start 2024-08-17T02:27:37.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3f1a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3d0004780 0x7fa3ec16d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3f1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 0x7fa3ec153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3f1a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3ec0ab0f0 0x7fa3ec0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3f1a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0abab0 con 0x7fa3ec155a50 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3f1a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec16d990 con 0x7fa3ec0ab0f0 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3f1a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec16c870 con 0x7fa3d0004780 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3ea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 0x7fa3ec153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3ea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 0x7fa3ec153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44082/0 (socket says 172.21.15.42:44082) 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3ea000640 1 -- 172.21.15.42:0/3604809966 learned_addr learned my addr 172.21.15.42:0/3604809966 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3eaa00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3d0004780 0x7fa3ec16d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.569+0000 7fa3eb400640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3ec0ab0f0 0x7fa3ec0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3ea000640 1 -- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3d0004780 msgr2=0x7fa3ec16d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3ea000640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3d0004780 0x7fa3ec16d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3ea000640 1 -- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3ec0ab0f0 msgr2=0x7fa3ec0ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3ea000640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3ec0ab0f0 0x7fa3ec0ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3ea000640 1 -- 172.21.15.42:0/3604809966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec16a400 con 0x7fa3ec155a50 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3eaa00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3d0004780 0x7fa3ec16d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3ea000640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 0x7fa3ec153cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3d802ab40 tx=0x7fa3d8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d803c700 con 0x7fa3ec155a50 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d803c860 con 0x7fa3ec155a50 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d803cc20 con 0x7fa3ec155a50 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.570+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec1697f0 con 0x7fa3ec155a50 2024-08-17T02:27:37.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.571+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec169db0 con 0x7fa3ec155a50 2024-08-17T02:27:37.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.572+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec16a590 con 0x7fa3ec155a50 2024-08-17T02:27:37.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.572+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa3d8042070 con 0x7fa3ec155a50 2024-08-17T02:27:37.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.573+0000 7fa3e2000640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3cc065180 0x7fa3cc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.573+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3d80a36d0 con 0x7fa3ec155a50 2024-08-17T02:27:37.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.573+0000 7fa3eaa00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3cc065180 0x7fa3cc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.574+0000 7fa3eaa00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3cc065180 0x7fa3cc067630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc001ed0 tx=0x7fa3dc007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.577+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa3d80717a0 con 0x7fa3ec155a50 2024-08-17T02:27:37.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.764+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3ec063fb0 con 0x7fa3ec155a50 2024-08-17T02:27:37.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.765+0000 7fa3e2000640 1 -- 172.21.15.42:0/3604809966 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa3d8074dc0 con 0x7fa3ec155a50 2024-08-17T02:27:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:37.765 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3cc065180 msgr2=0x7fa3cc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3cc065180 0x7fa3cc067630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc001ed0 tx=0x7fa3dc007040 comp rx=0 tx=0).stop 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 msgr2=0x7fa3ec153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 0x7fa3ec153cc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3d802ab40 tx=0x7fa3d8035000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 shutdown_connections 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa3cc065180 0x7fa3cc067630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3ec0ab0f0 0x7fa3ec0ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3ec155a50 0x7fa3ec153cc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 --2- 172.21.15.42:0/3604809966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3d0004780 0x7fa3ec16d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 >> 172.21.15.42:0/3604809966 conn(0x7fa3ec095a70 msgr2=0x7fa3ec06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 shutdown_connections 2024-08-17T02:27:37.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.767+0000 7fa3f1a00640 1 -- 172.21.15.42:0/3604809966 wait complete. 2024-08-17T02:27:37.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:37.783 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:37.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.936+0000 7fade2800640 1 Processor -- start 2024-08-17T02:27:37.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.937+0000 7fade2800640 1 -- start start 2024-08-17T02:27:37.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7fade2800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faddc158e60 0x7faddc0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7fade2800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faddc0b0ac0 0x7faddc0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7fade2800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0ad8a0 con 0x7faddc0ae860 2024-08-17T02:27:37.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7fade2800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc06edf0 con 0x7faddc158e60 2024-08-17T02:27:37.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7fade2800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0acc90 con 0x7faddc0b0ac0 2024-08-17T02:27:37.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7faddb400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faddc158e60 0x7faddc0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7faddb400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faddc158e60 0x7faddc0add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44090/0 (socket says 172.21.15.42:44090) 2024-08-17T02:27:37.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7faddb400640 1 -- 172.21.15.42:0/1880597646 learned_addr learned my addr 172.21.15.42:0/1880597646 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:37.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.938+0000 7faddbe00640 1 --2- 172.21.15.42:0/1880597646 >> v2:172.21.15.62:3300/0 conn(0x7faddc0b0ac0 0x7faddc0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.939+0000 7faddb400640 1 -- 172.21.15.42:0/1880597646 >> v2:172.21.15.62:3300/0 conn(0x7faddc0b0ac0 msgr2=0x7faddc0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.939+0000 7faddb400640 1 --2- 172.21.15.42:0/1880597646 >> v2:172.21.15.62:3300/0 conn(0x7faddc0b0ac0 0x7faddc0ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.939+0000 7faddb400640 1 -- 172.21.15.42:0/1880597646 >> v1:172.21.15.62:6789/0 conn(0x7faddc0ae860 legacy=0x7faddc0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.939+0000 7faddb400640 1 -- 172.21.15.42:0/1880597646 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0acf70 con 0x7faddc158e60 2024-08-17T02:27:37.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.939+0000 7faddb400640 1 --2- 172.21.15.42:0/1880597646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc158e60 0x7faddc0add30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faddc0c80c0 tx=0x7fadcc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc0be8bef396cc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7faddaa00640 1 -- 172.21.15.42:0/1880597646 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc02ae80 con 0x7faddc158e60 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7faddaa00640 1 -- 172.21.15.42:0/1880597646 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc032440 con 0x7faddc158e60 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7faddaa00640 1 -- 172.21.15.42:0/1880597646 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc032800 con 0x7faddc158e60 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7fade2800640 1 -- 172.21.15.42:0/1880597646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc158e60 msgr2=0x7faddc0add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7fade2800640 1 --2- 172.21.15.42:0/1880597646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc158e60 0x7faddc0add30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faddc0c80c0 tx=0x7fadcc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7fade2800640 1 -- 172.21.15.42:0/1880597646 shutdown_connections 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7fade2800640 1 --2- 172.21.15.42:0/1880597646 >> v2:172.21.15.62:3300/0 conn(0x7faddc0b0ac0 0x7faddc0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7fade2800640 1 --2- 172.21.15.42:0/1880597646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc158e60 0x7faddc0add30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.940+0000 7fade2800640 1 -- 172.21.15.42:0/1880597646 >> 172.21.15.42:0/1880597646 conn(0x7faddc0cc390 msgr2=0x7faddc066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.941+0000 7fade2800640 1 -- 172.21.15.42:0/1880597646 shutdown_connections 2024-08-17T02:27:37.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.941+0000 7fade2800640 1 -- 172.21.15.42:0/1880597646 wait complete. 2024-08-17T02:27:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.942+0000 7fade2800640 1 Processor -- start 2024-08-17T02:27:37.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.942+0000 7fade2800640 1 -- start start 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fade2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 0x7faddc141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fade2800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faddc0b0ac0 0x7faddc0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fade2800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faddc158e60 0x7faddc0af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fade2800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc167670 con 0x7faddc0ae860 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fade2800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc167950 con 0x7faddc0b0ac0 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fade2800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc167c30 con 0x7faddc158e60 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7faddb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 0x7faddc141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7faddb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 0x7faddc141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44104/0 (socket says 172.21.15.42:44104) 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7faddb400640 1 -- 172.21.15.42:0/3680444227 learned_addr learned my addr 172.21.15.42:0/3680444227 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7faddbe00640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faddc158e60 0x7faddc0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.943+0000 7fadd3e00640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faddc0b0ac0 0x7faddc0aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7faddb400640 1 -- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faddc158e60 msgr2=0x7faddc0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7faddb400640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faddc158e60 0x7faddc0af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7faddb400640 1 -- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faddc0b0ac0 msgr2=0x7faddc0aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7faddb400640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faddc0b0ac0 0x7faddc0aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7faddb400640 1 -- 172.21.15.42:0/3680444227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009450 con 0x7faddc0ae860 2024-08-17T02:27:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7faddb400640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 0x7faddc141f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009210 tx=0x7fadcc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc000d10 con 0x7faddc0ae860 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc031de0 con 0x7faddc0ae860 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc03d690 con 0x7faddc0ae860 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc167f10 con 0x7faddc0ae860 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.944+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc1668f0 con 0x7faddc0ae860 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.946+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc1427c0 con 0x7faddc0ae860 2024-08-17T02:27:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.946+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fadcc039040 con 0x7faddc0ae860 2024-08-17T02:27:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.947+0000 7fadd2a00640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadb8065150 0x7fadb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.947+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadcc0a2450 con 0x7faddc0ae860 2024-08-17T02:27:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.947+0000 7fadd3e00640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadb8065150 0x7fadb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.948+0000 7fadd3e00640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadb8065150 0x7fadb8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faddc0af910 tx=0x7fadc4007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:37.951+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fadcc070520 con 0x7faddc0ae860 2024-08-17T02:27:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.131+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faddc063fb0 con 0x7faddc0ae860 2024-08-17T02:27:38.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.132+0000 7fadd2a00640 1 -- 172.21.15.42:0/3680444227 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadcc037020 con 0x7faddc0ae860 2024-08-17T02:27:38.132 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:38.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadb8065150 msgr2=0x7fadb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadb8065150 0x7fadb8067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faddc0af910 tx=0x7fadc4007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:38.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 msgr2=0x7faddc141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 0x7faddc141f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009210 tx=0x7fadcc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 shutdown_connections 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fadb8065150 0x7fadb8067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faddc158e60 0x7faddc0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faddc0b0ac0 0x7faddc0aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 --2- 172.21.15.42:0/3680444227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faddc0ae860 0x7faddc141f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 >> 172.21.15.42:0/3680444227 conn(0x7faddc0cc390 msgr2=0x7faddc06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 shutdown_connections 2024-08-17T02:27:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.134+0000 7fade2800640 1 -- 172.21.15.42:0/3680444227 wait complete. 2024-08-17T02:27:38.149 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:38.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.303+0000 7f5e3dc00640 1 Processor -- start 2024-08-17T02:27:38.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.303+0000 7f5e3dc00640 1 -- start start 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e3dc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e38155040 0x7f5e38158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e3dc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e3806e770 0x7f5e380af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e3dc00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380aeeb0 con 0x7f5e381591c0 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e3dc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e38159610 con 0x7f5e3806e770 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e3dc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380aadd0 con 0x7f5e38155040 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e36000640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5e381591c0 0x7f5e3806e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56672/0 (socket says 172.21.15.42:56672) 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e36000640 1 -- 172.21.15.42:0/128815093 learned_addr learned my addr 172.21.15.42:0/128815093 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e36a00640 1 --2- 172.21.15.42:0/128815093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e38155040 0x7f5e38158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.304+0000 7f5e37400640 1 --2- 172.21.15.42:0/128815093 >> v2:172.21.15.62:3300/0 conn(0x7f5e3806e770 0x7f5e380af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.305+0000 7f5e35600640 1 -- 172.21.15.42:0/128815093 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83874628 0 0) 0x7f5e380aeeb0 con 0x7f5e381591c0 2024-08-17T02:27:38.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.305+0000 7f5e36a00640 1 -- 172.21.15.42:0/128815093 >> v2:172.21.15.62:3300/0 conn(0x7f5e3806e770 msgr2=0x7f5e380af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:38.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.305+0000 7f5e36a00640 1 --2- 172.21.15.42:0/128815093 >> v2:172.21.15.62:3300/0 conn(0x7f5e3806e770 0x7f5e380af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.305+0000 7f5e36a00640 1 -- 172.21.15.42:0/128815093 >> v1:172.21.15.42:6789/0 conn(0x7f5e381591c0 legacy=0x7f5e3806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.305+0000 7f5e36a00640 1 -- 172.21.15.42:0/128815093 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e381597f0 con 0x7f5e38155040 2024-08-17T02:27:38.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.306+0000 7f5e36a00640 1 --2- 172.21.15.42:0/128815093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e38155040 0x7f5e38158c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009850 tx=0x7f5e280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b62b517cd33b4d2f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.306+0000 7f5e35600640 1 -- 172.21.15.42:0/128815093 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2802ad00 con 0x7f5e38155040 2024-08-17T02:27:38.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e35600640 1 -- 172.21.15.42:0/128815093 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2802ae60 con 0x7f5e38155040 2024-08-17T02:27:38.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e35600640 1 -- 172.21.15.42:0/128815093 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28032670 con 0x7f5e38155040 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 -- 172.21.15.42:0/128815093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e38155040 msgr2=0x7f5e38158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/128815093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e38155040 0x7f5e38158c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009850 tx=0x7f5e280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 -- 172.21.15.42:0/128815093 shutdown_connections 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/128815093 >> v2:172.21.15.62:3300/0 conn(0x7f5e3806e770 0x7f5e380af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/128815093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e38155040 0x7f5e38158c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 -- 172.21.15.42:0/128815093 >> 172.21.15.42:0/128815093 conn(0x7f5e38066e60 msgr2=0x7f5e38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 -- 172.21.15.42:0/128815093 shutdown_connections 2024-08-17T02:27:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.307+0000 7f5e3dc00640 1 -- 172.21.15.42:0/128815093 wait complete. 2024-08-17T02:27:38.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.309+0000 7f5e3dc00640 1 Processor -- start 2024-08-17T02:27:38.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.309+0000 7f5e3dc00640 1 -- start start 2024-08-17T02:27:38.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e3dc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3806e770 0x7f5e380c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e3dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 0x7f5e3816d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e3dc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e381591c0 0x7f5e38147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e3dc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3814d290 con 0x7f5e38155040 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e3dc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381699f0 con 0x7f5e3806e770 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e3dc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38169cd0 con 0x7f5e381591c0 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 0x7f5e3816d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 0x7f5e3816d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44106/0 (socket says 172.21.15.42:44106) 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 -- 172.21.15.42:0/2874702204 learned_addr learned my addr 172.21.15.42:0/2874702204 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36a00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3806e770 0x7f5e380c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 -- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e381591c0 msgr2=0x7f5e38147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e381591c0 0x7f5e38147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 -- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3806e770 msgr2=0x7f5e380c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3806e770 0x7f5e380c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 -- 172.21.15.42:0/2874702204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28009390 con 0x7f5e38155040 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.310+0000 7f5e36000640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 0x7f5e3816d4b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c510 tx=0x7f5e2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.311+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24005aa0 con 0x7f5e38155040 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.311+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24005c00 con 0x7f5e38155040 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.311+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e38169fb0 con 0x7f5e38155040 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.311+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240070d0 con 0x7f5e38155040 2024-08-17T02:27:38.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.311+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3816d9f0 con 0x7f5e38155040 2024-08-17T02:27:38.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.312+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e38063fb0 con 0x7f5e38155040 2024-08-17T02:27:38.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.313+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e24007500 con 0x7f5e38155040 2024-08-17T02:27:38.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.314+0000 7f5e2e000640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5e18065150 0x7f5e18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.314+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e24081a90 con 0x7f5e38155040 2024-08-17T02:27:38.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.314+0000 7f5e36a00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5e18065150 0x7f5e18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.315+0000 7f5e36a00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5e18065150 0x7f5e18067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e28034000 tx=0x7f5e28032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.318+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e2404fab0 con 0x7f5e38155040 2024-08-17T02:27:38.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.498+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e3806b7b0 con 0x7f5e38155040 2024-08-17T02:27:38.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.499+0000 7f5e2e000640 1 -- 172.21.15.42:0/2874702204 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e24017020 con 0x7f5e38155040 2024-08-17T02:27:38.499 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5e18065150 msgr2=0x7f5e18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5e18065150 0x7f5e18067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e28034000 tx=0x7f5e28032000 comp rx=0 tx=0).stop 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 msgr2=0x7f5e3816d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 0x7f5e3816d4b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c510 tx=0x7f5e2400c910 comp rx=0 tx=0).stop 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 shutdown_connections 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5e18065150 0x7f5e18067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e381591c0 0x7f5e38147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e38155040 0x7f5e3816d4b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 --2- 172.21.15.42:0/2874702204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e3806e770 0x7f5e380c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.501+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 >> 172.21.15.42:0/2874702204 conn(0x7f5e38066e60 msgr2=0x7f5e3814da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.502+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 shutdown_connections 2024-08-17T02:27:38.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.502+0000 7f5e3dc00640 1 -- 172.21.15.42:0/2874702204 wait complete. 2024-08-17T02:27:38.516 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:38.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.669+0000 7fcf4be00640 1 Processor -- start 2024-08-17T02:27:38.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.670+0000 7fcf4be00640 1 -- start start 2024-08-17T02:27:38.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf4be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf44158bf0 0x7fcf440a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf4be00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf440aa430 0x7fcf440aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf4be00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf440a88e0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf4be00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440a9180 con 0x7fcf440aa430 2024-08-17T02:27:38.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf4be00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440aadc0 con 0x7fcf44158bf0 2024-08-17T02:27:38.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf49e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fcf4415a4d0 0x7fcf4415a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56674/0 (socket says 172.21.15.42:56674) 2024-08-17T02:27:38.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf49e00640 1 -- 172.21.15.42:0/99268552 learned_addr learned my addr 172.21.15.42:0/99268552 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:38.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf49400640 1 --2- 172.21.15.42:0/99268552 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf44158bf0 0x7fcf440a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.671+0000 7fcf48a00640 1 --2- 172.21.15.42:0/99268552 >> v2:172.21.15.62:3300/0 conn(0x7fcf440aa430 0x7fcf440aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf43e00640 1 -- 172.21.15.42:0/99268552 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228320838 0 0) 0x7fcf440a88e0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf43e00640 1 -- 172.21.15.42:0/99268552 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2c0034e0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf49400640 1 -- 172.21.15.42:0/99268552 >> v2:172.21.15.62:3300/0 conn(0x7fcf440aa430 msgr2=0x7fcf440aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf49400640 1 --2- 172.21.15.42:0/99268552 >> v2:172.21.15.62:3300/0 conn(0x7fcf440aa430 0x7fcf440aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf49400640 1 -- 172.21.15.42:0/99268552 >> v1:172.21.15.42:6789/0 conn(0x7fcf4415a4d0 legacy=0x7fcf4415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf49400640 1 -- 172.21.15.42:0/99268552 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4415a0e0 con 0x7fcf44158bf0 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.672+0000 7fcf48a00640 1 --2- 172.21.15.42:0/99268552 >> v2:172.21.15.62:3300/0 conn(0x7fcf440aa430 0x7fcf440aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:38.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.673+0000 7fcf49400640 1 --2- 172.21.15.42:0/99268552 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf44158bf0 0x7fcf440a9610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009850 tx=0x7fcf380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adde483d013ad82b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.673+0000 7fcf43e00640 1 -- 172.21.15.42:0/99268552 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3802ad90 con 0x7fcf44158bf0 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.673+0000 7fcf43e00640 1 -- 172.21.15.42:0/99268552 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38032440 con 0x7fcf44158bf0 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.673+0000 7fcf43e00640 1 -- 172.21.15.42:0/99268552 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38032820 con 0x7fcf44158bf0 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 -- 172.21.15.42:0/99268552 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf44158bf0 msgr2=0x7fcf440a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 --2- 172.21.15.42:0/99268552 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf44158bf0 0x7fcf440a9610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009850 tx=0x7fcf380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 -- 172.21.15.42:0/99268552 shutdown_connections 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 --2- 172.21.15.42:0/99268552 >> v2:172.21.15.62:3300/0 conn(0x7fcf440aa430 0x7fcf440aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 --2- 172.21.15.42:0/99268552 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf44158bf0 0x7fcf440a9610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 -- 172.21.15.42:0/99268552 >> 172.21.15.42:0/99268552 conn(0x7fcf44066e60 msgr2=0x7fcf44067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 -- 172.21.15.42:0/99268552 shutdown_connections 2024-08-17T02:27:38.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.674+0000 7fcf4be00640 1 -- 172.21.15.42:0/99268552 wait complete. 2024-08-17T02:27:38.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.675+0000 7fcf4be00640 1 Processor -- start 2024-08-17T02:27:38.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.676+0000 7fcf4be00640 1 -- start start 2024-08-17T02:27:38.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.676+0000 7fcf4be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf440aa430 0x7fcf4414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.676+0000 7fcf4be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf44158bf0 0x7fcf440caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.676+0000 7fcf4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 0x7fcf440c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf4be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44169a40 con 0x7fcf4415a4d0 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf4be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44168e30 con 0x7fcf44158bf0 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf4be00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44169110 con 0x7fcf440aa430 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 0x7fcf440c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 0x7fcf440c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44112/0 (socket says 172.21.15.42:44112) 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 -- 172.21.15.42:0/3664860732 learned_addr learned my addr 172.21.15.42:0/3664860732 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf48a00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf44158bf0 0x7fcf440caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49400640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf440aa430 0x7fcf4414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 -- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf440aa430 msgr2=0x7fcf4414a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf440aa430 0x7fcf4414a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 -- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf44158bf0 msgr2=0x7fcf440caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf44158bf0 0x7fcf440caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 -- 172.21.15.42:0/3664860732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009390 con 0x7fcf4415a4d0 2024-08-17T02:27:38.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.677+0000 7fcf49e00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 0x7fcf440c8820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c001460 tx=0x7fcf3c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.678+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00ce90 con 0x7fcf4415a4d0 2024-08-17T02:27:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.678+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00a850 con 0x7fcf4415a4d0 2024-08-17T02:27:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.678+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf38009390 con 0x7fcf4415a4d0 2024-08-17T02:27:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.678+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00ac50 con 0x7fcf4415a4d0 2024-08-17T02:27:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.678+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf441696d0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.679+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44169bf0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.680+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf3c007300 con 0x7fcf4415a4d0 2024-08-17T02:27:38.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.681+0000 7fcf40c00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf24065150 0x7fcf24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.681+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf3c0826c0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.681+0000 7fcf49400640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf24065150 0x7fcf24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.682+0000 7fcf49400640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf24065150 0x7fcf24067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcf38034000 tx=0x7fcf38032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.684+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf44169bf0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.864+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf44063fb0 con 0x7fcf4415a4d0 2024-08-17T02:27:38.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.865+0000 7fcf40c00640 1 -- 172.21.15.42:0/3664860732 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf3c050760 con 0x7fcf4415a4d0 2024-08-17T02:27:38.865 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:38.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf24065150 msgr2=0x7fcf24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf24065150 0x7fcf24067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcf38034000 tx=0x7fcf38032000 comp rx=0 tx=0).stop 2024-08-17T02:27:38.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 msgr2=0x7fcf440c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 0x7fcf440c8820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c001460 tx=0x7fcf3c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 shutdown_connections 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf24065150 0x7fcf24067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf4415a4d0 0x7fcf440c8820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf44158bf0 0x7fcf440caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 --2- 172.21.15.42:0/3664860732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf440aa430 0x7fcf4414a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 >> 172.21.15.42:0/3664860732 conn(0x7fcf44066e60 msgr2=0x7fcf44156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 shutdown_connections 2024-08-17T02:27:38.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:38.867+0000 7fcf4be00640 1 -- 172.21.15.42:0/3664860732 wait complete. 2024-08-17T02:27:38.882 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:39.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.033+0000 7fb9aea00640 1 Processor -- start 2024-08-17T02:27:39.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.033+0000 7fb9aea00640 1 -- start start 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.034+0000 7fb9aea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a81590b0 0x7fb9a80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.034+0000 7fb9aea00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80c92b0 con 0x7fb9a80acf10 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.034+0000 7fb9aea00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80ad480 con 0x7fb9a80afca0 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.034+0000 7fb9aea00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a80b0980 con 0x7fb9a81590b0 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.034+0000 7fb9aca00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb9a80acf10 0x7fb9a80c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56678/0 (socket says 172.21.15.42:56678) 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.034+0000 7fb9aca00640 1 -- 172.21.15.42:0/1252688852 learned_addr learned my addr 172.21.15.42:0/1252688852 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:39.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb99fe00640 1 --2- 172.21.15.42:0/1252688852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a81590b0 0x7fb9a80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121233408 0 0) 0x7fb9a80c92b0 con 0x7fb9a80acf10 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb98c0034e0 con 0x7fb9a80acf10 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490774906 0 0) 0x7fb9a80ad480 con 0x7fb9a80afca0 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a80c92b0 con 0x7fb9a80afca0 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb99fe00640 1 -- 172.21.15.42:0/1252688852 >> v1:172.21.15.62:6789/0 conn(0x7fb9a80afca0 legacy=0x7fb9a81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb99fe00640 1 -- 172.21.15.42:0/1252688852 >> v1:172.21.15.42:6789/0 conn(0x7fb9a80acf10 legacy=0x7fb9a80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.035+0000 7fb99fe00640 1 -- 172.21.15.42:0/1252688852 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80ad760 con 0x7fb9a81590b0 2024-08-17T02:27:39.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.036+0000 7fb99fe00640 1 --2- 172.21.15.42:0/1252688852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a81590b0 0x7fb9a80b0070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb990009880 tx=0x7fb9900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8640597abc65e229 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.036+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99002ae10 con 0x7fb9a81590b0 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990032440 con 0x7fb9a81590b0 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9a7400640 1 -- 172.21.15.42:0/1252688852 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900327e0 con 0x7fb9a81590b0 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 -- 172.21.15.42:0/1252688852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a81590b0 msgr2=0x7fb9a80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 --2- 172.21.15.42:0/1252688852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a81590b0 0x7fb9a80b0070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb990009880 tx=0x7fb9900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 -- 172.21.15.42:0/1252688852 shutdown_connections 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 --2- 172.21.15.42:0/1252688852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a81590b0 0x7fb9a80b0070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 -- 172.21.15.42:0/1252688852 >> 172.21.15.42:0/1252688852 conn(0x7fb9a8066e60 msgr2=0x7fb9a8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 -- 172.21.15.42:0/1252688852 shutdown_connections 2024-08-17T02:27:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.037+0000 7fb9aea00640 1 -- 172.21.15.42:0/1252688852 wait complete. 2024-08-17T02:27:39.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.039+0000 7fb9aea00640 1 Processor -- start 2024-08-17T02:27:39.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.039+0000 7fb9aea00640 1 -- start start 2024-08-17T02:27:39.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.039+0000 7fb9aea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 0x7fb9a80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9aea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a80afca0 0x7fb9a81531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9aea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a81590b0 0x7fb9a80a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9aea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a80a52c0 con 0x7fb9a80acf10 2024-08-17T02:27:39.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9aea00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a80a55a0 con 0x7fb9a81590b0 2024-08-17T02:27:39.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9aea00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a80a5880 con 0x7fb9a80afca0 2024-08-17T02:27:39.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 0x7fb9a80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 0x7fb9a80cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44124/0 (socket says 172.21.15.42:44124) 2024-08-17T02:27:39.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 -- 172.21.15.42:0/2917937060 learned_addr learned my addr 172.21.15.42:0/2917937060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:39.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb99fe00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a80afca0 0x7fb9a81531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9aca00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a81590b0 0x7fb9a80a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 -- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a80afca0 msgr2=0x7fb9a81531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a80afca0 0x7fb9a81531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 -- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a81590b0 msgr2=0x7fb9a80a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a81590b0 0x7fb9a80a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.040+0000 7fb9a7e00640 1 -- 172.21.15.42:0/2917937060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009390 con 0x7fb9a80acf10 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.041+0000 7fb9a7e00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 0x7fb9a80cbe20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c590 tx=0x7fb998007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.041+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998012630 con 0x7fb9a80acf10 2024-08-17T02:27:39.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.041+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980127b0 con 0x7fb9a80acf10 2024-08-17T02:27:39.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.041+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998012bb0 con 0x7fb9a80acf10 2024-08-17T02:27:39.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.041+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a80a5b60 con 0x7fb9a80acf10 2024-08-17T02:27:39.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.041+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a8153710 con 0x7fb9a80acf10 2024-08-17T02:27:39.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.042+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a8063fb0 con 0x7fb9a80acf10 2024-08-17T02:27:39.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.043+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb99801a3b0 con 0x7fb9a80acf10 2024-08-17T02:27:39.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.044+0000 7fb99f400640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb984065150 0x7fb984067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.044+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb9980822b0 con 0x7fb9a80acf10 2024-08-17T02:27:39.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.044+0000 7fb99fe00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb984065150 0x7fb984067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.045+0000 7fb99fe00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb984065150 0x7fb984067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb990034000 tx=0x7fb990032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.047+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb998050380 con 0x7fb9a80acf10 2024-08-17T02:27:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.267+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9a8067b70 con 0x7fb9a80acf10 2024-08-17T02:27:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.267+0000 7fb99f400640 1 -- 172.21.15.42:0/2917937060 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fb9980539a0 con 0x7fb9a80acf10 2024-08-17T02:27:39.268 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:39.268 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb984065150 msgr2=0x7fb984067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb984065150 0x7fb984067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb990034000 tx=0x7fb990032000 comp rx=0 tx=0).stop 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 msgr2=0x7fb9a80cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 0x7fb9a80cbe20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c590 tx=0x7fb998007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 shutdown_connections 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb984065150 0x7fb984067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9a81590b0 0x7fb9a80a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9a80afca0 0x7fb9a81531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 --2- 172.21.15.42:0/2917937060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9a80acf10 0x7fb9a80cbe20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.269+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 >> 172.21.15.42:0/2917937060 conn(0x7fb9a8066e60 msgr2=0x7fb9a80cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.270+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 shutdown_connections 2024-08-17T02:27:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.270+0000 7fb9aea00640 1 -- 172.21.15.42:0/2917937060 wait complete. 2024-08-17T02:27:39.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:39.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.436+0000 7fc712600640 1 Processor -- start 2024-08-17T02:27:39.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.436+0000 7fc712600640 1 -- start start 2024-08-17T02:27:39.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.437+0000 7fc712600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc70c15a490 0x7fc70c0ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.437+0000 7fc712600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c15b6b0 con 0x7fc70c158c60 2024-08-17T02:27:39.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.437+0000 7fc712600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c15aac0 con 0x7fc70c0b1920 2024-08-17T02:27:39.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.437+0000 7fc712600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c0b0540 con 0x7fc70c15a490 2024-08-17T02:27:39.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.437+0000 7fc711200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc70c158c60 0x7fc70c159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56682/0 (socket says 172.21.15.42:56682) 2024-08-17T02:27:39.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.437+0000 7fc711200640 1 -- 172.21.15.42:0/105153168 learned_addr learned my addr 172.21.15.42:0/105153168 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457865457 0 0) 0x7fc70c15b6b0 con 0x7fc70c158c60 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f40034e0 con 0x7fc70c158c60 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70be00640 1 --2- 172.21.15.42:0/105153168 >> v2:172.21.15.62:3300/0 conn(0x7fc70c15a490 0x7fc70c0ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126619695 0 0) 0x7fc6f40034e0 con 0x7fc70c158c60 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 >> v2:172.21.15.62:3300/0 conn(0x7fc70c15a490 msgr2=0x7fc70c0ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 --2- 172.21.15.42:0/105153168 >> v2:172.21.15.62:3300/0 conn(0x7fc70c15a490 0x7fc70c0ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 >> v1:172.21.15.62:6789/0 conn(0x7fc70c0b1920 legacy=0x7fc70c0b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c15ad80 con 0x7fc70c158c60 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fc700001470 con 0x7fc70c158c60 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 >> v1:172.21.15.42:6789/0 conn(0x7fc70c158c60 legacy=0x7fc70c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6f4003a40 0x7fc6f4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4004780 0x7fc6f4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4005230 0x7fc6f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0b0540 con 0x7fc6f4003a40 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f400c1f0 con 0x7fc6f4004780 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f400c3b0 con 0x7fc6f4005230 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.438+0000 7fc711200640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6f4003a40 0x7fc6f4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc70be00640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4004780 0x7fc6f4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc711200640 1 -- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4005230 msgr2=0x7fc6f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc711200640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4005230 0x7fc6f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc711200640 1 -- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4004780 msgr2=0x7fc6f4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc711200640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f4004780 0x7fc6f4004bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc711200640 1 -- 172.21.15.42:0/105153168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40034e0 con 0x7fc6f4003a40 2024-08-17T02:27:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.439+0000 7fc711c00640 1 -- 172.21.15.42:0/105153168 reap_dead start 2024-08-17T02:27:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc711200640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6f4003a40 0x7fc6f4003e50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c2d0 tx=0x7fc700001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95a85f506ba76d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700005890 con 0x7fc6f4003a40 2024-08-17T02:27:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700005a10 con 0x7fc6f4003a40 2024-08-17T02:27:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc70b400640 1 -- 172.21.15.42:0/105153168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700005dd0 con 0x7fc6f4003a40 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc712600640 1 -- 172.21.15.42:0/105153168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6f4003a40 msgr2=0x7fc6f4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc712600640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6f4003a40 0x7fc6f4003e50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c2d0 tx=0x7fc700001e50 comp rx=0 tx=0).stop 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc712600640 1 -- 172.21.15.42:0/105153168 shutdown_connections 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.440+0000 7fc712600640 1 --2- 172.21.15.42:0/105153168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6f4003a40 0x7fc6f4003e50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.441+0000 7fc712600640 1 -- 172.21.15.42:0/105153168 >> 172.21.15.42:0/105153168 conn(0x7fc70c06e590 msgr2=0x7fc70c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.441+0000 7fc712600640 1 -- 172.21.15.42:0/105153168 shutdown_connections 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.441+0000 7fc712600640 1 -- 172.21.15.42:0/105153168 wait complete. 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.442+0000 7fc712600640 1 Processor -- start 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.442+0000 7fc712600640 1 -- start start 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc712600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4003a40 0x7fc70c144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc712600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 0x7fc70c146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc712600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc70c15bb40 0x7fc70c0c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc712600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c4df0 con 0x7fc70c0c6270 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc712600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c41e0 con 0x7fc70c15bb40 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc712600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c44c0 con 0x7fc6f4003a40 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 0x7fc70c146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 0x7fc70c146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44142/0 (socket says 172.21.15.42:44142) 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 -- 172.21.15.42:0/4027085492 learned_addr learned my addr 172.21.15.42:0/4027085492 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc711c00640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc70c15bb40 0x7fc70c0c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc711200640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4003a40 0x7fc70c144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 -- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4003a40 msgr2=0x7fc70c144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4003a40 0x7fc70c144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 -- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc70c15bb40 msgr2=0x7fc70c0c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc70c15bb40 0x7fc70c0c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.443+0000 7fc70be00640 1 -- 172.21.15.42:0/4027085492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0c47a0 con 0x7fc70c0c6270 2024-08-17T02:27:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.444+0000 7fc70be00640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 0x7fc70c146940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800e8a0 tx=0x7fc6f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.444+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800ee30 con 0x7fc70c0c6270 2024-08-17T02:27:39.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.444+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800c6d0 con 0x7fc70c0c6270 2024-08-17T02:27:39.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.444+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800ca50 con 0x7fc70c0c6270 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.444+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c0c4a80 con 0x7fc70c0c6270 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.444+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c15bfb0 con 0x7fc70c0c6270 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.445+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c15c290 con 0x7fc70c0c6270 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.446+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc6f8013410 con 0x7fc70c0c6270 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.447+0000 7fc6ffe00640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6ec065220 0x7fc6ec0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.447+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6f8082290 con 0x7fc70c0c6270 2024-08-17T02:27:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.447+0000 7fc711200640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6ec065220 0x7fc6ec0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.448+0000 7fc711200640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6ec065220 0x7fc6ec0676d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc700033000 tx=0x7fc700031000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.451+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6f80502a0 con 0x7fc70c0c6270 2024-08-17T02:27:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.637+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc70c0c4c10 con 0x7fc70c0c6270 2024-08-17T02:27:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.638+0000 7fc6ffe00640 1 -- 172.21.15.42:0/4027085492 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fc6f80538c0 con 0x7fc70c0c6270 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:39.639 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6ec065220 msgr2=0x7fc6ec0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6ec065220 0x7fc6ec0676d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc700033000 tx=0x7fc700031000 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 msgr2=0x7fc70c146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 0x7fc70c146940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800e8a0 tx=0x7fc6f8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 shutdown_connections 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6ec065220 0x7fc6ec0676d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc70c15bb40 0x7fc70c0c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc70c0c6270 0x7fc70c146940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 --2- 172.21.15.42:0/4027085492 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6f4003a40 0x7fc70c144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 >> 172.21.15.42:0/4027085492 conn(0x7fc70c06e590 msgr2=0x7fc70c0cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 shutdown_connections 2024-08-17T02:27:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.640+0000 7fc712600640 1 -- 172.21.15.42:0/4027085492 wait complete. 2024-08-17T02:27:39.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:39.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.806+0000 7f6cd6200640 1 Processor -- start 2024-08-17T02:27:39.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.806+0000 7f6cd6200640 1 -- start start 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6cd6200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 0x7f6cd00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6cd6200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6cd00acf10 0x7f6cd0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6cd6200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd015a4e0 con 0x7f6cd00afca0 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6cd6200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd00b0980 con 0x7f6cd00acf10 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6cd6200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00c92b0 con 0x7f6cd01590b0 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6ccf400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6cd00afca0 0x7f6cd01589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56698/0 (socket says 172.21.15.42:56698) 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.807+0000 7f6ccf400640 1 -- 172.21.15.42:0/2313696858 learned_addr learned my addr 172.21.15.42:0/2313696858 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccfe00640 1 --2- 172.21.15.42:0/2313696858 >> v2:172.21.15.62:3300/0 conn(0x7f6cd00acf10 0x7f6cd0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 0x7f6cd00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420398963 0 0) 0x7f6cc0001490 con 0x7f6cd00afca0 2024-08-17T02:27:39.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb40034e0 con 0x7f6cd00afca0 2024-08-17T02:27:39.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274497914 0 0) 0x7f6cb40034e0 con 0x7f6cd00afca0 2024-08-17T02:27:39.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 msgr2=0x7f6cd00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 0x7f6cd00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 >> v2:172.21.15.62:3300/0 conn(0x7f6cd00acf10 msgr2=0x7f6cd0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 --2- 172.21.15.42:0/2313696858 >> v2:172.21.15.62:3300/0 conn(0x7f6cd00acf10 0x7f6cd0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00ad480 con 0x7f6cd00afca0 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f6cc0001980 con 0x7f6cd00afca0 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 >> v1:172.21.15.42:6789/0 conn(0x7f6cd00afca0 legacy=0x7f6cd01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb40039d0 0x7f6cb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb4004780 0x7f6cb4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 0x7f6cb4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00c92b0 con 0x7f6cb4004780 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400dbe0 con 0x7f6cb40039d0 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400dd20 con 0x7f6cd01590b0 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6ccfe00640 1 --2- 172.21.15.42:0/2313696858 >> v2:172.21.15.62:3300/0 conn(0x7f6cd00acf10 0x7f6cd0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:39.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.808+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb4004780 0x7f6cb4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6ccf400640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb40039d0 0x7f6cb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6ccfe00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 0x7f6cb4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6cc6a00640 1 -- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 msgr2=0x7f6cb4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cd01590b0 0x7f6cb4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6cc6a00640 1 -- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb40039d0 msgr2=0x7f6cb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cb40039d0 0x7f6cb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.809+0000 7f6cc6a00640 1 -- 172.21.15.42:0/2313696858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40034e0 con 0x7f6cb4004780 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.810+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb4004780 0x7f6cb4004bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009ba0 tx=0x7f6cb80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7132382b6b443b6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.810+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8031400 con 0x7f6cb4004780 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.810+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb802d050 con 0x7f6cb4004780 2024-08-17T02:27:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.810+0000 7f6ccea00640 1 -- 172.21.15.42:0/2313696858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8031790 con 0x7f6cb4004780 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6cd6200640 1 -- 172.21.15.42:0/2313696858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb4004780 msgr2=0x7f6cb4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6cd6200640 1 --2- 172.21.15.42:0/2313696858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb4004780 0x7f6cb4004bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009ba0 tx=0x7f6cb80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6ccfe00640 1 -- 172.21.15.42:0/2313696858 reap_dead start 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6cd6200640 1 -- 172.21.15.42:0/2313696858 shutdown_connections 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6cd6200640 1 -- 172.21.15.42:0/2313696858 >> 172.21.15.42:0/2313696858 conn(0x7f6cd0066e60 msgr2=0x7f6cd0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6cd6200640 1 -- 172.21.15.42:0/2313696858 shutdown_connections 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.811+0000 7f6cd6200640 1 -- 172.21.15.42:0/2313696858 wait complete. 2024-08-17T02:27:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.812+0000 7f6cd6200640 1 Processor -- start 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.812+0000 7f6cd6200640 1 -- start start 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cd6200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cb4004780 0x7f6cd0156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cd6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 0x7f6cd0150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cd6200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cd00c1860 0x7f6cd00c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cd6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0164b30 con 0x7f6cd00ca100 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cd6200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00c2210 con 0x7f6cd00c1860 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cd6200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0156c30 con 0x7f6cb4004780 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cc6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 0x7f6cd0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6ccf400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cb4004780 0x7f6cd0156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cc6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 0x7f6cd0150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44166/0 (socket says 172.21.15.42:44166) 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6cc6a00640 1 -- 172.21.15.42:0/1205787992 learned_addr learned my addr 172.21.15.42:0/1205787992 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:39.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.813+0000 7f6ccfe00640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cd00c1860 0x7f6cd00c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccf400640 1 -- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cd00c1860 msgr2=0x7f6cd00c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccf400640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cd00c1860 0x7f6cd00c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccf400640 1 -- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 msgr2=0x7f6cd0150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccf400640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 0x7f6cd0150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccf400640 1 -- 172.21.15.42:0/1205787992 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00ca6c0 con 0x7f6cb4004780 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 0x7f6cd0150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccfe00640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cd00c1860 0x7f6cd00c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6ccf400640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cb4004780 0x7f6cd0156fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000ac00 tx=0x7f6cd00683f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00077f0 con 0x7f6cb4004780 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.814+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0007970 con 0x7f6cb4004780 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.815+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd00ca9a0 con 0x7f6cb4004780 2024-08-17T02:27:39.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.815+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0013640 con 0x7f6cb4004780 2024-08-17T02:27:39.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.815+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd00caf60 con 0x7f6cb4004780 2024-08-17T02:27:39.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.816+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd0063fb0 con 0x7f6cb4004780 2024-08-17T02:27:39.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.816+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6cc00139b0 con 0x7f6cb4004780 2024-08-17T02:27:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.817+0000 7f6cc7400640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cac065150 0x7f6cac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.817+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6cc0082d00 con 0x7f6cb4004780 2024-08-17T02:27:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.818+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cac065150 0x7f6cac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.818+0000 7f6cc6a00640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cac065150 0x7f6cac067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009130 tx=0x7f6cb8035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:39.822+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6cc0050d20 con 0x7f6cb4004780 2024-08-17T02:27:40.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.045+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cd015a4e0 con 0x7f6cb4004780 2024-08-17T02:27:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.045+0000 7f6cc7400640 1 -- 172.21.15.42:0/1205787992 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f6cd015a4e0 con 0x7f6cb4004780 2024-08-17T02:27:40.046 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:40.046 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:27:40.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cac065150 msgr2=0x7f6cac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cac065150 0x7f6cac067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009130 tx=0x7f6cb8035000 comp rx=0 tx=0).stop 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cb4004780 msgr2=0x7f6cd0156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cb4004780 0x7f6cd0156fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000ac00 tx=0x7f6cd00683f0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 shutdown_connections 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cac065150 0x7f6cac067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cd00c1860 0x7f6cd00c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd00ca100 0x7f6cd0150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 --2- 172.21.15.42:0/1205787992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cb4004780 0x7f6cd0156fc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 >> 172.21.15.42:0/1205787992 conn(0x7f6cd0066e60 msgr2=0x7f6cd0069910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 shutdown_connections 2024-08-17T02:27:40.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.048+0000 7f6cd6200640 1 -- 172.21.15.42:0/1205787992 wait complete. 2024-08-17T02:27:40.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:27:24.861445+0000', 'modified': '2024-08-17T02:27:28.444016+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/1740596523', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1740596523}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1740596523}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:27:40.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:27:40.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:27:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.623+0000 7f6bc8400640 1 Processor -- start 2024-08-17T02:27:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.623+0000 7f6bc8400640 1 -- start start 2024-08-17T02:27:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.624+0000 7f6bc8400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6bc00ae8d0 0x7f6bc00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.624+0000 7f6bc8400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6bc00aff50 0x7f6bc00aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.624+0000 7f6bc8400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc00cb180 con 0x7f6bc00af1e0 2024-08-17T02:27:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.624+0000 7f6bc8400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc00ad410 con 0x7f6bc00aff50 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.624+0000 7f6bc8400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc00ad6b0 con 0x7f6bc00ae8d0 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc6400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6bc00af1e0 0x7f6bc00c8ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:56706/0 (socket says 172.21.15.42:56706) 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc6400640 1 -- 172.21.15.42:0/203086027 learned_addr learned my addr 172.21.15.42:0/203086027 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc5000640 1 --2- 172.21.15.42:0/203086027 >> v2:172.21.15.42:3300/0 conn(0x7f6bc00aff50 0x7f6bc00aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/203086027 >> v2:172.21.15.62:3300/0 conn(0x7f6bc00ae8d0 0x7f6bc00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bbfe00640 1 -- 172.21.15.42:0/203086027 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611138938 0 0) 0x7f6bc00cb180 con 0x7f6bc00af1e0 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bbfe00640 1 -- 172.21.15.42:0/203086027 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba80034e0 con 0x7f6bc00af1e0 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc5000640 1 -- 172.21.15.42:0/203086027 >> v2:172.21.15.62:3300/0 conn(0x7f6bc00ae8d0 msgr2=0x7f6bc00aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc5000640 1 --2- 172.21.15.42:0/203086027 >> v2:172.21.15.62:3300/0 conn(0x7f6bc00ae8d0 0x7f6bc00aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc5000640 1 -- 172.21.15.42:0/203086027 >> v1:172.21.15.42:6789/0 conn(0x7f6bc00af1e0 legacy=0x7f6bc00c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.625+0000 7f6bc5000640 1 -- 172.21.15.42:0/203086027 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00ad990 con 0x7f6bc00aff50 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.626+0000 7f6bc5000640 1 --2- 172.21.15.42:0/203086027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00aff50 0x7f6bc00aeca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6bc006f550 tx=0x7f6bac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52428bb7d4bffa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bbfe00640 1 -- 172.21.15.42:0/203086027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac02adb0 con 0x7f6bc00aff50 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bbfe00640 1 -- 172.21.15.42:0/203086027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac032440 con 0x7f6bc00aff50 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bbfe00640 1 -- 172.21.15.42:0/203086027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac032820 con 0x7f6bc00aff50 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 -- 172.21.15.42:0/203086027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00aff50 msgr2=0x7f6bc00aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 --2- 172.21.15.42:0/203086027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00aff50 0x7f6bc00aeca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6bc006f550 tx=0x7f6bac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 -- 172.21.15.42:0/203086027 shutdown_connections 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 --2- 172.21.15.42:0/203086027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00aff50 0x7f6bc00aeca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 --2- 172.21.15.42:0/203086027 >> v2:172.21.15.62:3300/0 conn(0x7f6bc00ae8d0 0x7f6bc00aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 -- 172.21.15.42:0/203086027 >> 172.21.15.42:0/203086027 conn(0x7f6bc0066e60 msgr2=0x7f6bc0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 -- 172.21.15.42:0/203086027 shutdown_connections 2024-08-17T02:27:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.627+0000 7f6bc8400640 1 -- 172.21.15.42:0/203086027 wait complete. 2024-08-17T02:27:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.629+0000 7f6bc8400640 1 Processor -- start 2024-08-17T02:27:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.629+0000 7f6bc8400640 1 -- start start 2024-08-17T02:27:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc8400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc00ae8d0 0x7f6bc01554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc8400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 0x7f6bc0168e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc8400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc00aff50 0x7f6bc015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc8400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc01559e0 con 0x7f6bc00af1e0 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc8400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc015bcb0 con 0x7f6bc00aff50 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc8400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc015bf90 con 0x7f6bc00ae8d0 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 0x7f6bc0168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 0x7f6bc0168e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44180/0 (socket says 172.21.15.42:44180) 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc5000640 1 -- 172.21.15.42:0/2381642906 learned_addr learned my addr 172.21.15.42:0/2381642906 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc00ae8d0 0x7f6bc01554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.630+0000 7f6bc6400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc00aff50 0x7f6bc015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc5000640 1 -- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc00ae8d0 msgr2=0x7f6bc01554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc00ae8d0 0x7f6bc01554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc5000640 1 -- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc00aff50 msgr2=0x7f6bc015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc00aff50 0x7f6bc015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc5000640 1 -- 172.21.15.42:0/2381642906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009390 con 0x7f6bc00af1e0 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 0x7f6bc0168e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bac035040 tx=0x7f6bac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bbcc00640 1 -- 172.21.15.42:0/2381642906 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac031c20 con 0x7f6bc00af1e0 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bbcc00640 1 -- 172.21.15.42:0/2381642906 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac031d80 con 0x7f6bc00af1e0 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bbcc00640 1 -- 172.21.15.42:0/2381642906 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac03d670 con 0x7f6bc00af1e0 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc015c270 con 0x7f6bc00af1e0 2024-08-17T02:27:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.631+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc015c830 con 0x7f6bc00af1e0 2024-08-17T02:27:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.633+0000 7f6bbcc00640 1 -- 172.21.15.42:0/2381642906 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6bac039040 con 0x7f6bc00af1e0 2024-08-17T02:27:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.634+0000 7f6bbcc00640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6ba0065150 0x7f6ba0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.634+0000 7f6bbcc00640 1 -- 172.21.15.42:0/2381642906 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bac0a22f0 con 0x7f6bc00af1e0 2024-08-17T02:27:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.634+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6ba0065150 0x7f6ba0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.635+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6ba0065150 0x7f6ba0067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d20 tx=0x7f6bb40090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.635+0000 7f6bca97a740 1 Processor -- start 2024-08-17T02:27:40.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.635+0000 7f6bca97a740 1 -- start start 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb13810a30 0x55bb13810e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb1382eb10 0x55bb137e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bca97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb137a6380 con 0x55bb137ec0a0 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb1374f9e0 con 0x55bb1382eb10 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb1374d170 con 0x55bb13810a30 2024-08-17T02:27:40.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44188/0 (socket says 172.21.15.42:44188) 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 -- 172.21.15.42:0/3995199411 learned_addr learned my addr 172.21.15.42:0/3995199411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb13810a30 0x55bb13810e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 -- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb13810a30 msgr2=0x55bb13810e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb13810a30 0x55bb13810e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 -- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb1382eb10 msgr2=0x55bb137e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc6400640 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb1382eb10 0x55bb137e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb1382eb10 0x55bb137e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5000640 1 -- 172.21.15.42:0/3995199411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb136fc820 con 0x55bb137ec0a0 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.636+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb13810a30 0x55bb13810e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:40.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.637+0000 7f6bc5000640 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382e5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bac070580 tx=0x7f6bac0a06d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c88f8bb970338b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.637+0000 7f6bb1600640 1 -- 172.21.15.42:0/3995199411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac074080 con 0x55bb137ec0a0 2024-08-17T02:27:40.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.637+0000 7f6bb1600640 1 -- 172.21.15.42:0/3995199411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac077220 con 0x55bb137ec0a0 2024-08-17T02:27:40.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.637+0000 7f6bb1600640 1 -- 172.21.15.42:0/3995199411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac07af70 con 0x55bb137ec0a0 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.637+0000 7f6bca97a740 1 -- 172.21.15.42:0/3995199411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 msgr2=0x55bb1382e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.637+0000 7f6bca97a740 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382e5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6bac070580 tx=0x7f6bac0a06d0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 -- 172.21.15.42:0/3995199411 shutdown_connections 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb1382eb10 0x55bb137e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382e5d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 --2- 172.21.15.42:0/3995199411 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb13810a30 0x55bb13810e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 -- 172.21.15.42:0/3995199411 >> 172.21.15.42:0/3995199411 conn(0x55bb13784030 msgr2=0x55bb13832c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 -- 172.21.15.42:0/3995199411 shutdown_connections 2024-08-17T02:27:40.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 -- 172.21.15.42:0/3995199411 wait complete. 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.638+0000 7f6bca97a740 1 -- start start 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.639+0000 7f6bca97a740 1 Processor -- start 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.639+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb13814b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb1380ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13817f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bca97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb13748f60 con 0x55bb1382eb10 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb136f1690 con 0x55bb13810a30 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb136f1330 con 0x55bb137ec0a0 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bca97a740 10 client.0 _ll_register_callbacks cb 0x55bb136eb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13817f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13817f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44200/0 (socket says 172.21.15.42:44200) 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 -- 172.21.15.42:0/4016660795 learned_addr learned my addr 172.21.15.42:0/4016660795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb13814b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 -- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 msgr2=0x55bb13814b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb13814b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 -- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 msgr2=0x55bb1380ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc5000640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb1380ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb1380ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 -- 172.21.15.42:0/4016660795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc015c830 con 0x55bb1382eb10 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb13814b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6bc6400640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13817f60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8007920 tx=0x7f6bb8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a6aae237a21271 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.640+0000 7f6ba6000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6ba6000640 1 -- 172.21.15.42:0/4016660795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80107c0 con 0x55bb1382eb10 2024-08-17T02:27:40.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6ba6000640 1 -- 172.21.15.42:0/4016660795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bb8010920 con 0x55bb1382eb10 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb1377cd20 con 0x55bb1382eb10 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6ba6000640 1 -- 172.21.15.42:0/4016660795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bb8010cf0 con 0x55bb1382eb10 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 10 client.4596 fetch_fsmap learned FSMap version 7 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55bb13712ab0 con 0x55bb1382eb10 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6ba6000640 1 -- 172.21.15.42:0/4016660795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb1377cd20 con 0x55bb1382eb10 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6ba6000640 1 -- 172.21.15.42:0/4016660795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6bb8014400 con 0x55bb1382eb10 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 10 client.4596 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 10 client.4596 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 20 client.4596 populate_metadata read hostname 'smithi042' 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb138496d0 0x55bb1384bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 4 client.4596 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 --> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb134503c0 con 0x55bb138496d0 2024-08-17T02:27:40.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.641+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb138496d0 0x55bb1384bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.642+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb138496d0 0x55bb1384bab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a0b80994a5696d server_cookie=c1347cc03505a62b in_seq=0 out_seq=0 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.642+0000 7f6ba6000640 10 client.4596 ms_handle_connect on v2:172.21.15.42:6834/1740596523 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6ba6000640 1 -- 172.21.15.42:0/4016660795 <== mds.0 v2:172.21.15.42:6834/1740596523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55bb134503c0 con 0x55bb138496d0 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6ba6000640 10 client.4596 handle_command_reply: tid=0 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 client.4596 shutdown 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 msgr2=0x55bb13817f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13817f60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8007920 tx=0x7f6bb8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 shutdown_connections 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb138496d0 0x55bb1384bab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13817f60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb1380ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 --2- 172.21.15.42:0/4016660795 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb13814b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6ba6000640 0 client.4596 ms_handle_reset on v2:172.21.15.42:6834/1740596523 2024-08-17T02:27:40.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 >> 172.21.15.42:0/4016660795 conn(0x55bb13784030 msgr2=0x55bb1382e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 shutdown_connections 2024-08-17T02:27:40.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 1 -- 172.21.15.42:0/4016660795 wait complete. 2024-08-17T02:27:40.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.643+0000 7f6bca97a740 20 client.4596 trim_cache size 0 max 16384 2024-08-17T02:27:40.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.659+0000 7f6bca97a740 1 Processor -- start 2024-08-17T02:27:40.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.659+0000 7f6bca97a740 1 -- start start 2024-08-17T02:27:40.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb137e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb13832750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13832c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bca97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb134c3f20 con 0x55bb1382eb10 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb138413d0 con 0x55bb13810a30 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb137e8e60 con 0x55bb137ec0a0 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bc6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13832c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bc6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13832c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44216/0 (socket says 172.21.15.42:44216) 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bc6400640 1 -- 172.21.15.42:0/1809200791 learned_addr learned my addr 172.21.15.42:0/1809200791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb137e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.660+0000 7f6bc5000640 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb13832750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc6400640 1 -- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 msgr2=0x55bb137e52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc6400640 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb137e52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc6400640 1 -- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 msgr2=0x55bb13832750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc6400640 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb13832750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc6400640 1 -- 172.21.15.42:0/1809200791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb137e91d0 con 0x55bb1382eb10 2024-08-17T02:27:40.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc5000640 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb13832750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:40.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bc6400640 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13832c90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80148e0 tx=0x7f6bb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64859c37ed913de5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bb2000640 1 -- 172.21.15.42:0/1809200791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8007420 con 0x55bb1382eb10 2024-08-17T02:27:40.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bb2000640 1 -- 172.21.15.42:0/1809200791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb80105b0 con 0x55bb1382eb10 2024-08-17T02:27:40.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.661+0000 7f6bb2000640 1 -- 172.21.15.42:0/1809200791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8001db0 con 0x55bb1382eb10 2024-08-17T02:27:40.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 -- 172.21.15.42:0/1809200791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 msgr2=0x55bb13832c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13832c90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80148e0 tx=0x7f6bb8017000 comp rx=0 tx=0).stop 2024-08-17T02:27:40.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 -- 172.21.15.42:0/1809200791 shutdown_connections 2024-08-17T02:27:40.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb1382eb10 0x55bb13832c90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb13832750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 --2- 172.21.15.42:0/1809200791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb137ec0a0 0x55bb137e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 -- 172.21.15.42:0/1809200791 >> 172.21.15.42:0/1809200791 conn(0x55bb13784030 msgr2=0x55bb13817d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 -- 172.21.15.42:0/1809200791 shutdown_connections 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 -- 172.21.15.42:0/1809200791 wait complete. 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.662+0000 7f6bca97a740 1 -- start start 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.663+0000 7f6bca97a740 1 Processor -- start 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.663+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb137eae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bca97a740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb1382eb10 0x55bb138968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bca97a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb138961f0 con 0x55bb137ec0a0 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb1382b930 con 0x55bb13810a30 2024-08-17T02:27:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bca97a740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb13899c30 con 0x55bb1382eb10 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bca97a740 10 client.0 _ll_register_callbacks cb 0x7f6bb8001d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44230/0 (socket says 172.21.15.42:44230) 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 -- 172.21.15.42:0/2191699183 learned_addr learned my addr 172.21.15.42:0/2191699183 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb137eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc6400640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb1382eb10 0x55bb138968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 -- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb1382eb10 msgr2=0x55bb138968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb1382eb10 0x55bb138968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 -- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 msgr2=0x55bb137eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb137eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 -- 172.21.15.42:0/2191699183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb13712ab0 con 0x55bb137ec0a0 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb137eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:40.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6bc5a00640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382b030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009bd0 tx=0x7f6bb4027490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd2119bddbefcb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.664+0000 7f6ba6000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6ba6000640 1 -- 172.21.15.42:0/2191699183 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4026050 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6ba6000640 1 -- 172.21.15.42:0/2191699183 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bb401a040 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6bac077220 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6ba6000640 1 -- 172.21.15.42:0/2191699183 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bb40272a0 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 10 client.4602 fetch_fsmap learned FSMap version 7 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55bb13716490 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6ba6000640 1 -- 172.21.15.42:0/2191699183 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac077220 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6ba6000640 1 -- 172.21.15.42:0/2191699183 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6bb4027500 con 0x55bb137ec0a0 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 10 client.4602 fetch_fsmap finished waiting for FSMap version 7 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 10 client.4602 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:27:40.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 20 client.4602 populate_metadata read hostname 'smithi042' 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb13832750 0x55bb13832b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 4 client.4602 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 --> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bb134616c0 con 0x55bb13832750 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.665+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb13832750 0x55bb13832b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bc5000640 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb13832750 0x55bb13832b20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18424a946f53e6f6 server_cookie=be7c1c629269ae33 in_seq=0 out_seq=0 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6ba6000640 10 client.4602 ms_handle_connect on v2:172.21.15.42:6834/1740596523 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6ba6000640 1 -- 172.21.15.42:0/2191699183 <== mds.0 v2:172.21.15.42:6834/1740596523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55bb134616c0 con 0x55bb13832750 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6ba6000640 10 client.4602 handle_command_reply: tid=0 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 client.4602 shutdown 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 msgr2=0x55bb1382b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382b030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009bd0 tx=0x7f6bb4027490 comp rx=0 tx=0).stop 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 shutdown_connections 2024-08-17T02:27:40.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:6834/1740596523,v1:172.21.15.42:6835/1740596523] conn(0x55bb13832750 0x55bb13832b20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55bb1382eb10 0x55bb138968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb13810a30 0x55bb137eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 --2- 172.21.15.42:0/2191699183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bb137ec0a0 0x55bb1382b030 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6ba6000640 0 client.4602 ms_handle_reset on v2:172.21.15.42:6834/1740596523 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.666+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 >> 172.21.15.42:0/2191699183 conn(0x55bb13784030 msgr2=0x55bb137ea620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 shutdown_connections 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bca97a740 1 -- 172.21.15.42:0/2191699183 wait complete. 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bca97a740 20 client.4602 trim_cache size 0 max 16384 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:27:40.672 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0", 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4270, 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 15.233696493, 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 7, 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 21, 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 22.510761414000001 2024-08-17T02:27:40.673 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:27:40.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6ba0065150 msgr2=0x7f6ba0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bc8400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6ba0065150 0x7f6ba0067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009d20 tx=0x7f6bb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 msgr2=0x7f6bc0168e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.667+0000 7f6bc8400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 0x7f6bc0168e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bac035040 tx=0x7f6bac032000 comp rx=0 tx=0).stop 2024-08-17T02:27:40.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 shutdown_connections 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6ba0065150 0x7f6ba0067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6bc00aff50 0x7f6bc015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bc00af1e0 0x7f6bc0168e20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 --2- 172.21.15.42:0/2381642906 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6bc00ae8d0 0x7f6bc01554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 >> 172.21.15.42:0/2381642906 conn(0x7f6bc0066e60 msgr2=0x7f6bc0158560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 shutdown_connections 2024-08-17T02:27:40.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:40.668+0000 7f6bc8400640 1 -- 172.21.15.42:0/2381642906 wait complete. 2024-08-17T02:27:40.683 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:27:40.707 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:27:40.707 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:27:40.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.707 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:27:40.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-17T02:27:40.843 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:40.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:40.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.846 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:27:40.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.882 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-17T02:27:40.980 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:40.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:40.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:40.983 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:27:41.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:41.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-08-17T02:27:41.131 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:41.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:41.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:41.135 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:27:41.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:41.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-08-17T02:27:41.271 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:41.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:41.274 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:27:41.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.427+0000 7efc98600640 1 Processor -- start 2024-08-17T02:27:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.427+0000 7efc98600640 1 -- start start 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.428+0000 7efc98600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc900ca050 0x7efc90156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.428+0000 7efc98600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efc900add30 0x7efc9015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.428+0000 7efc98600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9015b5e0 con 0x7efc900ad960 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.428+0000 7efc98600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900cb160 con 0x7efc900add30 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.428+0000 7efc98600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900b0d10 con 0x7efc900ca050 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efc900add30 0x7efc9015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efc900add30 0x7efc9015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37922/0 (socket says 172.21.15.42:37922) 2024-08-17T02:27:41.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 -- 172.21.15.42:0/769933067 learned_addr learned my addr 172.21.15.42:0/769933067 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc95200640 1 --2- 172.21.15.42:0/769933067 >> v2:172.21.15.62:3300/0 conn(0x7efc900ca050 0x7efc90156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 -- 172.21.15.42:0/769933067 >> v2:172.21.15.62:3300/0 conn(0x7efc900ca050 msgr2=0x7efc90156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 --2- 172.21.15.42:0/769933067 >> v2:172.21.15.62:3300/0 conn(0x7efc900ca050 0x7efc90156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 -- 172.21.15.42:0/769933067 >> v1:172.21.15.62:6789/0 conn(0x7efc900ad960 legacy=0x7efc90156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.429+0000 7efc96600640 1 -- 172.21.15.42:0/769933067 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900ca550 con 0x7efc900add30 2024-08-17T02:27:41.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.430+0000 7efc96600640 1 --2- 172.21.15.42:0/769933067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900add30 0x7efc9015b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc90063600 tx=0x7efc88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea518543f2c61425 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.430+0000 7efc8fe00640 1 -- 172.21.15.42:0/769933067 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88032470 con 0x7efc900add30 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.430+0000 7efc8fe00640 1 -- 172.21.15.42:0/769933067 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc880325d0 con 0x7efc900add30 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc8fe00640 1 -- 172.21.15.42:0/769933067 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880329b0 con 0x7efc900add30 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 -- 172.21.15.42:0/769933067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900add30 msgr2=0x7efc9015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 --2- 172.21.15.42:0/769933067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900add30 0x7efc9015b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc90063600 tx=0x7efc88009840 comp rx=0 tx=0).stop 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 -- 172.21.15.42:0/769933067 shutdown_connections 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 --2- 172.21.15.42:0/769933067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900add30 0x7efc9015b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 --2- 172.21.15.42:0/769933067 >> v2:172.21.15.62:3300/0 conn(0x7efc900ca050 0x7efc90156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 -- 172.21.15.42:0/769933067 >> 172.21.15.42:0/769933067 conn(0x7efc90066e60 msgr2=0x7efc90067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 -- 172.21.15.42:0/769933067 shutdown_connections 2024-08-17T02:27:41.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.431+0000 7efc98600640 1 -- 172.21.15.42:0/769933067 wait complete. 2024-08-17T02:27:41.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.433+0000 7efc98600640 1 Processor -- start 2024-08-17T02:27:41.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.433+0000 7efc98600640 1 -- start start 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc98600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 0x7efc90168da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc98600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc900add30 0x7efc9006a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc98600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc900ca050 0x7efc90158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc98600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9006af20 con 0x7efc900ad960 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc98600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900ac330 con 0x7efc900add30 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc98600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc900aba00 con 0x7efc900ca050 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 0x7efc90168da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 0x7efc90168da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37932/0 (socket says 172.21.15.42:37932) 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 -- 172.21.15.42:0/3490762961 learned_addr learned my addr 172.21.15.42:0/3490762961 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc96600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc900ca050 0x7efc90158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95200640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc900add30 0x7efc9006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 -- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc900ca050 msgr2=0x7efc90158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc900ca050 0x7efc90158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 -- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc900add30 msgr2=0x7efc9006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc900add30 0x7efc9006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95c00640 1 -- 172.21.15.42:0/3490762961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc88009ae0 con 0x7efc900ad960 2024-08-17T02:27:41.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.434+0000 7efc95200640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc900add30 0x7efc9006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:41.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.435+0000 7efc95c00640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 0x7efc90168da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc8400c4c0 tx=0x7efc84007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.435+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84011590 con 0x7efc900ad960 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.435+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84011710 con 0x7efc900ad960 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.435+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84011ad0 con 0x7efc900ad960 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.435+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc900abce0 con 0x7efc900ad960 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.435+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc901692e0 con 0x7efc900ad960 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.436+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc90063fb0 con 0x7efc900ad960 2024-08-17T02:27:41.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.437+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc8401b3b0 con 0x7efc900ad960 2024-08-17T02:27:41.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.438+0000 7efc8cc00640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efc700651d0 0x7efc70067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.438+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc84081750 con 0x7efc900ad960 2024-08-17T02:27:41.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.438+0000 7efc95200640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efc700651d0 0x7efc70067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.438+0000 7efc95200640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efc700651d0 0x7efc70067680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006fd0 tx=0x7efc7c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.442+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc8404f820 con 0x7efc900ad960 2024-08-17T02:27:41.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.668+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc9015b5e0 con 0x7efc900ad960 2024-08-17T02:27:41.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.669+0000 7efc8cc00640 1 -- 172.21.15.42:0/3490762961 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc9015b5e0 con 0x7efc900ad960 2024-08-17T02:27:41.669 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efc700651d0 msgr2=0x7efc70067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efc700651d0 0x7efc70067680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006fd0 tx=0x7efc7c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 msgr2=0x7efc90168da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 0x7efc90168da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc8400c4c0 tx=0x7efc84007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 shutdown_connections 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efc700651d0 0x7efc70067680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc900ca050 0x7efc90158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc900add30 0x7efc9006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 --2- 172.21.15.42:0/3490762961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc900ad960 0x7efc90168da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 >> 172.21.15.42:0/3490762961 conn(0x7efc90066e60 msgr2=0x7efc90153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 shutdown_connections 2024-08-17T02:27:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:41.671+0000 7efc98600640 1 -- 172.21.15.42:0/3490762961 wait complete. 2024-08-17T02:27:41.686 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:41.686 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:41.686 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-08-17T02:27:41.686 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:27:41.686 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:41.687 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:41.687 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:41.687 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:41.687 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:41.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:41.687 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42628sec preferred_lft 42628sec 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-08-17T02:27:41.724 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:27:41.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:27:41.725 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:42.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.102 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:42.160 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-08-17T02:27:42.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.163 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-08-17T02:27:42.206 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-08-17T02:27:42.206 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:42.206 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:27:42.206 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:27:42.206 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:42.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.207 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:42.207 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:42.207 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:27:42.207 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:27:42.207 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:27:42.207 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:42.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.941 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:27:42.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:42.977 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-08-17T02:27:43.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.053 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:43.053 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:43.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:43.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:27:43.053 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:43.180 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:27:43.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.180 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:27:43.181 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:43.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:43.367 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:43.367 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:43.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-08-17T02:27:43.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:27:43.367 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:43.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:43.485 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:43.520 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:43.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:43.521 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:43.596 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:27:43.596 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:43.596 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:43.737 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:43.737 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:44.332 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:44.332 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:44.333 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-08-17T02:27:44.333 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 0@f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0.cephfs=/ 2024-08-17T02:27:44.333 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.42:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-08-17T02:27:44.333 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:27:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:44.334 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:44.337 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:44.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:44.337 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:44.394 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:27:44.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.545+0000 7ff666c00640 1 Processor -- start 2024-08-17T02:27:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.545+0000 7ff666c00640 1 -- start start 2024-08-17T02:27:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660158c60 0x7ff66015a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff660159030 0x7ff6600ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66015b6b0 con 0x7ff660159420 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600b0540 con 0x7ff660159030 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66015aac0 con 0x7ff660158c60 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff660159420 0x7ff6600b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44698/0 (socket says 172.21.15.42:44698) 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff666200640 1 -- 172.21.15.42:0/2552008747 learned_addr learned my addr 172.21.15.42:0/2552008747 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff665800640 1 --2- 172.21.15.42:0/2552008747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660158c60 0x7ff66015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.546+0000 7ff664e00640 1 --2- 172.21.15.42:0/2552008747 >> v2:172.21.15.62:3300/0 conn(0x7ff660159030 0x7ff6600ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff65fe00640 1 -- 172.21.15.42:0/2552008747 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073615393 0 0) 0x7ff66015b6b0 con 0x7ff660159420 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff65fe00640 1 -- 172.21.15.42:0/2552008747 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6480034e0 con 0x7ff660159420 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff665800640 1 -- 172.21.15.42:0/2552008747 >> v2:172.21.15.62:3300/0 conn(0x7ff660159030 msgr2=0x7ff6600ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff665800640 1 --2- 172.21.15.42:0/2552008747 >> v2:172.21.15.62:3300/0 conn(0x7ff660159030 0x7ff6600ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff665800640 1 -- 172.21.15.42:0/2552008747 >> v1:172.21.15.42:6789/0 conn(0x7ff660159420 legacy=0x7ff6600b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff665800640 1 -- 172.21.15.42:0/2552008747 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66015ad80 con 0x7ff660158c60 2024-08-17T02:27:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.547+0000 7ff664e00640 1 --2- 172.21.15.42:0/2552008747 >> v2:172.21.15.62:3300/0 conn(0x7ff660159030 0x7ff6600ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.548+0000 7ff665800640 1 --2- 172.21.15.42:0/2552008747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660158c60 0x7ff66015a490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff654009850 tx=0x7ff6540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02d3de953c5c806 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.548+0000 7ff65fe00640 1 -- 172.21.15.42:0/2552008747 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65402ad00 con 0x7ff660158c60 2024-08-17T02:27:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.548+0000 7ff65fe00640 1 -- 172.21.15.42:0/2552008747 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65402ae60 con 0x7ff660158c60 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.548+0000 7ff65fe00640 1 -- 172.21.15.42:0/2552008747 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654032670 con 0x7ff660158c60 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 -- 172.21.15.42:0/2552008747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660158c60 msgr2=0x7ff66015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 --2- 172.21.15.42:0/2552008747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660158c60 0x7ff66015a490 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff654009850 tx=0x7ff6540090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 -- 172.21.15.42:0/2552008747 shutdown_connections 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 --2- 172.21.15.42:0/2552008747 >> v2:172.21.15.62:3300/0 conn(0x7ff660159030 0x7ff6600ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 --2- 172.21.15.42:0/2552008747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660158c60 0x7ff66015a490 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 -- 172.21.15.42:0/2552008747 >> 172.21.15.42:0/2552008747 conn(0x7ff66006e590 msgr2=0x7ff66006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 -- 172.21.15.42:0/2552008747 shutdown_connections 2024-08-17T02:27:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.549+0000 7ff666c00640 1 -- 172.21.15.42:0/2552008747 wait complete. 2024-08-17T02:27:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.550+0000 7ff666c00640 1 Processor -- start 2024-08-17T02:27:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 -- start start 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff660158c60 0x7ff6601689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 0x7ff6600d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660159420 0x7ff6600c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660169960 con 0x7ff660159030 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601693a0 con 0x7ff660158c60 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.551+0000 7ff666c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff660169680 con 0x7ff660159420 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 0x7ff6600d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 0x7ff6600d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37934/0 (socket says 172.21.15.42:37934) 2024-08-17T02:27:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 -- 172.21.15.42:0/498733289 learned_addr learned my addr 172.21.15.42:0/498733289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff666200640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660159420 0x7ff6600c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff665800640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff660158c60 0x7ff6601689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 -- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660159420 msgr2=0x7ff6600c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660159420 0x7ff6600c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 -- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff660158c60 msgr2=0x7ff6601689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff660158c60 0x7ff6601689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 -- 172.21.15.42:0/498733289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c009390 con 0x7ff660159030 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff665800640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff660158c60 0x7ff6601689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff666200640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660159420 0x7ff6600c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.552+0000 7ff664e00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 0x7ff6600d0100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00ec80 tx=0x7ff64c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.553+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00eec0 con 0x7ff660159030 2024-08-17T02:27:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.553+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00cbc0 con 0x7ff660159030 2024-08-17T02:27:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.553+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff654009390 con 0x7ff660159030 2024-08-17T02:27:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.553+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c013470 con 0x7ff660159030 2024-08-17T02:27:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.553+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6600cfbe0 con 0x7ff660159030 2024-08-17T02:27:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.554+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff660070720 con 0x7ff660159030 2024-08-17T02:27:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.555+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff64c0137e0 con 0x7ff660159030 2024-08-17T02:27:44.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.555+0000 7ff65cc00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff640065150 0x7ff640067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.556+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff64c0828e0 con 0x7ff660159030 2024-08-17T02:27:44.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.556+0000 7ff665800640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff640065150 0x7ff640067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.557+0000 7ff665800640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff640065150 0x7ff640067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff654034000 tx=0x7ff654032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.560+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff64c050900 con 0x7ff660159030 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.782+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6600b4f70 con 0x7ff660159030 2024-08-17T02:27:44.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.783+0000 7ff65cc00640 1 -- 172.21.15.42:0/498733289 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff64c021070 con 0x7ff660159030 2024-08-17T02:27:44.783 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff640065150 msgr2=0x7ff640067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff640065150 0x7ff640067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff654034000 tx=0x7ff654032000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 msgr2=0x7ff6600d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 0x7ff6600d0100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00ec80 tx=0x7ff64c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 shutdown_connections 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff640065150 0x7ff640067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff660159420 0x7ff6600c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff660159030 0x7ff6600d0100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 --2- 172.21.15.42:0/498733289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff660158c60 0x7ff6601689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 >> 172.21.15.42:0/498733289 conn(0x7ff66006e590 msgr2=0x7ff6600b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 shutdown_connections 2024-08-17T02:27:44.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:44.785+0000 7ff666c00640 1 -- 172.21.15.42:0/498733289 wait complete. 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:44.800 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:27:44.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:44.800 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:44.837 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42625sec preferred_lft 42625sec 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-08-17T02:27:44.838 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 7e:25:12:09:13:29 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::4060:65ff:fea9:4731/64 scope link 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 7e:25:12:09:13:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::7c25:12ff:fe09:1329/64 scope link 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:44.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:44.840 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:44.930 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-08-17T02:27:44.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:44.934 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:44.970 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:44.970 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:44.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:27:44.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:27:44.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:27:44.971 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:45.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.116 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:27:45.151 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:45.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.152 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-08-17T02:27:45.226 INFO:teuthology.orchestra.run.smithi042.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:27:45.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.228 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:45.228 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:45.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:45.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:27:45.228 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 4a:bb:8b:42:fe:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:45.411 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.412 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::48bb:8bff:fe42:fe3f/64 scope link 2024-08-17T02:27:45.412 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.414 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 4a:bb:8b:42:fe:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:45.470 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:45.471 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.471 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::48bb:8bff:fe42:fe3f/64 scope link 2024-08-17T02:27:45.471 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:45.473 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:27:45.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.473 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:45.473 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:45.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:27:45.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:45.474 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:27:45.474 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:27:45.474 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:27:45.474 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:45.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:45.641 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:27:45.641 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:27:45.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.1 up 2024-08-17T02:27:45.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:27:45.642 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:45.758 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:45.793 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:45.867 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:27:45.867 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:45.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:45.991 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:45.991 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-08-17T02:27:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 2@f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0.cephfs=/ 2024-08-17T02:27:46.019 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.42:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-08-17T02:27:46.020 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:27:46.020 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:46.020 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:46.020 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:46.020 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:46.023 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:46.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:46.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:46.079 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:27:46.079 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.230+0000 7f1c97200640 1 Processor -- start 2024-08-17T02:27:46.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.230+0000 7f1c97200640 1 -- start start 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.231+0000 7f1c97200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900afca0 0x7f1c900b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c97200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c900acf10 0x7f1c90159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c97200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1c901589a0 0x7f1c90158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c97200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c900b0980 con 0x7f1c901589a0 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c97200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9015a4e0 con 0x7f1c900acf10 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c97200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c92b0 con 0x7f1c900afca0 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1c901589a0 0x7f1c90158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1c901589a0 0x7f1c90158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37942/0 (socket says 172.21.15.42:37942) 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 -- 172.21.15.42:0/2622290077 learned_addr learned my addr 172.21.15.42:0/2622290077 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c8f400640 1 --2- 172.21.15.42:0/2622290077 >> v2:172.21.15.62:3300/0 conn(0x7f1c900acf10 0x7f1c90159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c8fe00640 1 --2- 172.21.15.42:0/2622290077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900afca0 0x7f1c900b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 -- 172.21.15.42:0/2622290077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900afca0 msgr2=0x7f1c900b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 --2- 172.21.15.42:0/2622290077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900afca0 0x7f1c900b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 -- 172.21.15.42:0/2622290077 >> v2:172.21.15.62:3300/0 conn(0x7f1c900acf10 msgr2=0x7f1c90159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 --2- 172.21.15.42:0/2622290077 >> v2:172.21.15.62:3300/0 conn(0x7f1c900acf10 0x7f1c90159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.232+0000 7f1c95200640 1 -- 172.21.15.42:0/2622290077 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90159360 con 0x7f1c901589a0 2024-08-17T02:27:46.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.233+0000 7f1c95200640 1 --2- 172.21.15.42:0/2622290077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c901589a0 0x7f1c90158e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009f20 tx=0x7f1c88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d8095f0541c267 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c8ea00640 1 -- 172.21.15.42:0/2622290077 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c88031400 con 0x7f1c901589a0 2024-08-17T02:27:46.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c8ea00640 1 -- 172.21.15.42:0/2622290077 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8802d050 con 0x7f1c901589a0 2024-08-17T02:27:46.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c8ea00640 1 -- 172.21.15.42:0/2622290077 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c880317d0 con 0x7f1c901589a0 2024-08-17T02:27:46.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 -- 172.21.15.42:0/2622290077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c901589a0 msgr2=0x7f1c90158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 --2- 172.21.15.42:0/2622290077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c901589a0 0x7f1c90158e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009f20 tx=0x7f1c88009840 comp rx=0 tx=0).stop 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 -- 172.21.15.42:0/2622290077 shutdown_connections 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 --2- 172.21.15.42:0/2622290077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c901589a0 0x7f1c90158e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 --2- 172.21.15.42:0/2622290077 >> v2:172.21.15.62:3300/0 conn(0x7f1c900acf10 0x7f1c90159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 --2- 172.21.15.42:0/2622290077 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900afca0 0x7f1c900b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 -- 172.21.15.42:0/2622290077 >> 172.21.15.42:0/2622290077 conn(0x7f1c90066e60 msgr2=0x7f1c90067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 -- 172.21.15.42:0/2622290077 shutdown_connections 2024-08-17T02:27:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.234+0000 7f1c97200640 1 -- 172.21.15.42:0/2622290077 wait complete. 2024-08-17T02:27:46.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.236+0000 7f1c97200640 1 Processor -- start 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.236+0000 7f1c97200640 1 -- start start 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c97200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900acf10 0x7f1c90153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c97200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 0x7f1c900c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c97200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c901589a0 0x7f1c900c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c97200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90164ca0 con 0x7f1c900afca0 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c97200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901544d0 con 0x7f1c901589a0 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c97200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901547b0 con 0x7f1c900acf10 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 0x7f1c900c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 0x7f1c900c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37954/0 (socket says 172.21.15.42:37954) 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 -- 172.21.15.42:0/2643952312 learned_addr learned my addr 172.21.15.42:0/2643952312 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8fe00640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900acf10 0x7f1c90153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c95200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c901589a0 0x7f1c900c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 -- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900acf10 msgr2=0x7f1c90153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900acf10 0x7f1c90153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 -- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c901589a0 msgr2=0x7f1c900c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c901589a0 0x7f1c900c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.237+0000 7f1c8f400640 1 -- 172.21.15.42:0/2643952312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88009ae0 con 0x7f1c900afca0 2024-08-17T02:27:46.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.238+0000 7f1c8f400640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 0x7f1c900c7c60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00d890 tx=0x7f1c7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.238+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c00de20 con 0x7f1c900afca0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.238+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c0098b0 con 0x7f1c900afca0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.238+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c90154a90 con 0x7f1c900afca0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.238+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c009c50 con 0x7f1c900afca0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.238+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c900c1960 con 0x7f1c900afca0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.239+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c900c1be0 con 0x7f1c900afca0 2024-08-17T02:27:46.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.240+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1c7c014620 con 0x7f1c900afca0 2024-08-17T02:27:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.241+0000 7f1c87400640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1c70065150 0x7f1c70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.241+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c7c082d30 con 0x7f1c900afca0 2024-08-17T02:27:46.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.241+0000 7f1c8fe00640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1c70065150 0x7f1c70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.242+0000 7f1c8fe00640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1c70065150 0x7f1c70067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000bb40 tx=0x7f1c80008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.245+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1c7c050d50 con 0x7f1c900afca0 2024-08-17T02:27:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.463+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c90063fb0 con 0x7f1c900afca0 2024-08-17T02:27:46.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.463+0000 7f1c87400640 1 -- 172.21.15.42:0/2643952312 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c7c009db0 con 0x7f1c900afca0 2024-08-17T02:27:46.463 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1c70065150 msgr2=0x7f1c70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1c70065150 0x7f1c70067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000bb40 tx=0x7f1c80008040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 msgr2=0x7f1c900c7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 0x7f1c900c7c60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00d890 tx=0x7f1c7c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 shutdown_connections 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1c70065150 0x7f1c70067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c901589a0 0x7f1c900c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c900afca0 0x7f1c900c7c60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 --2- 172.21.15.42:0/2643952312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c900acf10 0x7f1c90153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 >> 172.21.15.42:0/2643952312 conn(0x7f1c90066e60 msgr2=0x7f1c900cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 shutdown_connections 2024-08-17T02:27:46.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:46.465+0000 7f1c97200640 1 -- 172.21.15.42:0/2643952312 wait complete. 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:46.480 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:46.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:46.481 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-08-17T02:27:46.520 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:46.520 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:46.521 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:27:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42637sec preferred_lft 42637sec 2024-08-17T02:27:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-08-17T02:27:46.522 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:46.523 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:27:46.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:46.523 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:46.523 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:46.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:27:46.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2024-08-17T02:27:46.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2024-08-17T02:27:46.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:27:46.524 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:46.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:46.895 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-08-17T02:27:46.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:46.954 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-08-17T02:27:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-08-17T02:27:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:27:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:47.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:47.002 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:47.002 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:47.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:47.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:47.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:47.002 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:47.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:47.534 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:47.571 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-08-17T02:27:47.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:47.646 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:47.646 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:47.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:47.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:27:47.646 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:47.772 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:27:47.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:27:47.773 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:47.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:47.965 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:47.965 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:47.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-08-17T02:27:47.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:27:47.965 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:48.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:48.081 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:48.115 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:27:48.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:48.116 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:48.191 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:27:48.191 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:48.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:48.323 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:48.323 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:48.982 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:48.982 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:48.982 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-08-17T02:27:48.982 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with new device syntax: 1@f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0.cephfs=/ 2024-08-17T02:27:48.982 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.42:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-08-17T02:27:48.983 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:27:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:48.983 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:48.986 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:48.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:48.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:27:49.043 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:27:49.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.205+0000 7f1eb5200640 1 Processor -- start 2024-08-17T02:27:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.205+0000 7f1eb5200640 1 -- start start 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eb5200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1eb0158b90 0x7f1eb00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eb5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb00b2370 0x7f1eb00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eb5200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00af380 con 0x7f1eb00aef60 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eb5200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00afd20 con 0x7f1eb0158b90 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eb5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00affe0 con 0x7f1eb00b2370 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eae800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1eb00aef60 0x7f1eb0068630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44714/0 (socket says 172.21.15.42:44714) 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.206+0000 7f1eae800640 1 -- 172.21.15.42:0/1680952799 learned_addr learned my addr 172.21.15.42:0/1680952799 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1eade00640 1 --2- 172.21.15.42:0/1680952799 >> v2:172.21.15.62:3300/0 conn(0x7f1eb0158b90 0x7f1eb00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1ead400640 1 --2- 172.21.15.42:0/1680952799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb00b2370 0x7f1eb00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1eaca00640 1 -- 172.21.15.42:0/1680952799 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672795843 0 0) 0x7f1eb00af380 con 0x7f1eb00aef60 2024-08-17T02:27:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1eaca00640 1 -- 172.21.15.42:0/1680952799 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e940034e0 con 0x7f1eb00aef60 2024-08-17T02:27:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1ead400640 1 -- 172.21.15.42:0/1680952799 >> v2:172.21.15.62:3300/0 conn(0x7f1eb0158b90 msgr2=0x7f1eb00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1ead400640 1 --2- 172.21.15.42:0/1680952799 >> v2:172.21.15.62:3300/0 conn(0x7f1eb0158b90 0x7f1eb00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1ead400640 1 -- 172.21.15.42:0/1680952799 >> v1:172.21.15.42:6789/0 conn(0x7f1eb00aef60 legacy=0x7f1eb0068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1ead400640 1 -- 172.21.15.42:0/1680952799 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00b02c0 con 0x7f1eb00b2370 2024-08-17T02:27:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.207+0000 7f1eade00640 1 --2- 172.21.15.42:0/1680952799 >> v2:172.21.15.62:3300/0 conn(0x7f1eb0158b90 0x7f1eb00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.208+0000 7f1ead400640 1 --2- 172.21.15.42:0/1680952799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb00b2370 0x7f1eb00aea20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009850 tx=0x7f1e9c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc72ce1fd8b60f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eaca00640 1 -- 172.21.15.42:0/1680952799 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c02ad90 con 0x7f1eb00b2370 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eaca00640 1 -- 172.21.15.42:0/1680952799 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c032440 con 0x7f1eb00b2370 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eaca00640 1 -- 172.21.15.42:0/1680952799 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c032800 con 0x7f1eb00b2370 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 -- 172.21.15.42:0/1680952799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb00b2370 msgr2=0x7f1eb00aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1680952799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb00b2370 0x7f1eb00aea20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009850 tx=0x7f1e9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 -- 172.21.15.42:0/1680952799 shutdown_connections 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1680952799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb00b2370 0x7f1eb00aea20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1680952799 >> v2:172.21.15.62:3300/0 conn(0x7f1eb0158b90 0x7f1eb00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 -- 172.21.15.42:0/1680952799 >> 172.21.15.42:0/1680952799 conn(0x7f1eb006e590 msgr2=0x7f1eb006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 -- 172.21.15.42:0/1680952799 shutdown_connections 2024-08-17T02:27:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.209+0000 7f1eb5200640 1 -- 172.21.15.42:0/1680952799 wait complete. 2024-08-17T02:27:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.211+0000 7f1eb5200640 1 Processor -- start 2024-08-17T02:27:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.211+0000 7f1eb5200640 1 -- start start 2024-08-17T02:27:49.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eb5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eb00aef60 0x7f1eb0157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eb5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 0x7f1eb015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eb5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb0158b90 0x7f1eb0169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eb5200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb015c8c0 con 0x7f1eb00b2370 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eb5200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb015cb60 con 0x7f1eb00aef60 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eb5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb015ce40 con 0x7f1eb0158b90 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 0x7f1eb015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 0x7f1eb015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37958/0 (socket says 172.21.15.42:37958) 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 -- 172.21.15.42:0/1609337131 learned_addr learned my addr 172.21.15.42:0/1609337131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eade00640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eb00aef60 0x7f1eb0157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1eae800640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb0158b90 0x7f1eb0169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 -- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb0158b90 msgr2=0x7f1eb0169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb0158b90 0x7f1eb0169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 -- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eb00aef60 msgr2=0x7f1eb0157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eb00aef60 0x7f1eb0157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.212+0000 7f1ead400640 1 -- 172.21.15.42:0/1609337131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0009390 con 0x7f1eb00b2370 2024-08-17T02:27:49.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.213+0000 7f1ead400640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 0x7f1eb015d920 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009130 tx=0x7f1e9c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.213+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c03e660 con 0x7f1eb00b2370 2024-08-17T02:27:49.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.213+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c03e800 con 0x7f1eb00b2370 2024-08-17T02:27:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.213+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c009390 con 0x7f1eb00b2370 2024-08-17T02:27:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.213+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c03ebc0 con 0x7f1eb00b2370 2024-08-17T02:27:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.213+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb015d400 con 0x7f1eb00b2370 2024-08-17T02:27:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.214+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb015d620 con 0x7f1eb00b2370 2024-08-17T02:27:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.215+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e9c031420 con 0x7f1eb00b2370 2024-08-17T02:27:49.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.216+0000 7f1ea5600640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1e90065150 0x7f1e90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.216+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e9c0a2790 con 0x7f1eb00b2370 2024-08-17T02:27:49.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.216+0000 7f1eade00640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1e90065150 0x7f1e90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.217+0000 7f1eade00640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1e90065150 0x7f1e90067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00cbee0 tx=0x7f1ea00090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.220+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e9c070860 con 0x7f1eb00b2370 2024-08-17T02:27:49.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.442+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1eb0063fb0 con 0x7f1eb00b2370 2024-08-17T02:27:49.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.443+0000 7f1ea5600640 1 -- 172.21.15.42:0/1609337131 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e9c037060 con 0x7f1eb00b2370 2024-08-17T02:27:49.443 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1e90065150 msgr2=0x7f1e90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1e90065150 0x7f1e90067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00cbee0 tx=0x7f1ea00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 msgr2=0x7f1eb015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 0x7f1eb015d920 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009130 tx=0x7f1e9c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 shutdown_connections 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1e90065150 0x7f1e90067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1eb0158b90 0x7f1eb0169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb00b2370 0x7f1eb015d920 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 --2- 172.21.15.42:0/1609337131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1eb00aef60 0x7f1eb0157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 >> 172.21.15.42:0/1609337131 conn(0x7f1eb006e590 msgr2=0x7f1eb00cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 shutdown_connections 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:49.445+0000 7f1eb5200640 1 -- 172.21.15.42:0/1609337131 wait complete. 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:49.462 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:27:49.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.463 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-08-17T02:27:49.500 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:49.500 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:49.500 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:49.500 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:49.501 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42634sec preferred_lft 42634sec 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 62:c5:68:c8:4a:59 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::94f1:cdff:fee8:fb85/64 scope link 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 62:c5:68:c8:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:27:49.502 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::60c5:68ff:fec8:4a59/64 scope link 2024-08-17T02:27:49.503 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:49.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.503 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:49.595 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-08-17T02:27:49.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.598 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-08-17T02:27:49.634 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-08-17T02:27:49.634 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:49.635 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:27:49.635 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:27:49.635 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:49.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.635 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:49.635 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:49.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:27:49.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:27:49.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:27:49.635 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:49.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:49.657 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:49.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.781 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:27:49.857 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:27:49.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.857 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-08-17T02:27:49.933 INFO:teuthology.orchestra.run.smithi062.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:27:49.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:49.934 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:49.934 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:49.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:27:49.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:27:49.934 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:50.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:50.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:27:50.113 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:50.113 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 9e:1e:28:1e:bf:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::9c1e:28ff:fe1e:bfdc/64 scope link 2024-08-17T02:27:50.114 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:50.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:27:50.174 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 9e:1e:28:1e:bf:dc brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::9c1e:28ff:fe1e:bfdc/64 scope link 2024-08-17T02:27:50.175 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:50.176 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:27:50.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:50.176 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:50.176 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:50.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:27:50.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:50.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:27:50.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:27:50.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:27:50.177 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:50.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:50.343 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:27:50.343 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:27:50.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.1 up 2024-08-17T02:27:50.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:27:50.344 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:27:50.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:50.459 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:50.493 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:27:50.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:50.494 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:50.568 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:27:50.568 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:50.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:50.690 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:50.690 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:50.716 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with new device syntax: 3@f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0.cephfs=/ 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.42:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:50.717 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:50.718 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:50.721 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:50.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:50.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:27:50.776 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:27:50.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.951+0000 7fcd95800640 1 Processor -- start 2024-08-17T02:27:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.951+0000 7fcd95800640 1 -- start start 2024-08-17T02:27:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.952+0000 7fcd95800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcd901590b0 0x7fcd900b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.952+0000 7fcd95800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcd900acf10 0x7fcd90159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.952+0000 7fcd95800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9015a4e0 con 0x7fcd900afca0 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.952+0000 7fcd95800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900b0980 con 0x7fcd901590b0 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.952+0000 7fcd95800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900c92b0 con 0x7fcd900acf10 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcd901590b0 0x7fcd900b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcd901590b0 0x7fcd900b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37336/0 (socket says 172.21.15.42:37336) 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 -- 172.21.15.42:0/2663689158 learned_addr learned my addr 172.21.15.42:0/2663689158 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8f400640 1 --2- 172.21.15.42:0/2663689158 >> v2:172.21.15.62:3300/0 conn(0x7fcd900acf10 0x7fcd90159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 -- 172.21.15.42:0/2663689158 >> v2:172.21.15.62:3300/0 conn(0x7fcd900acf10 msgr2=0x7fcd90159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 --2- 172.21.15.42:0/2663689158 >> v2:172.21.15.62:3300/0 conn(0x7fcd900acf10 0x7fcd90159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 -- 172.21.15.42:0/2663689158 >> v1:172.21.15.62:6789/0 conn(0x7fcd900afca0 legacy=0x7fcd901589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.953+0000 7fcd8e000640 1 -- 172.21.15.42:0/2663689158 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900ad480 con 0x7fcd901590b0 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.954+0000 7fcd8e000640 1 --2- 172.21.15.42:0/2663689158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd900b0070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd900cb4a0 tx=0x7fcd7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c76cbf904b8c66b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.954+0000 7fcd8d600640 1 -- 172.21.15.42:0/2663689158 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c031510 con 0x7fcd901590b0 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.954+0000 7fcd8d600640 1 -- 172.21.15.42:0/2663689158 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c02f050 con 0x7fcd901590b0 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.954+0000 7fcd8d600640 1 -- 172.21.15.42:0/2663689158 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0318e0 con 0x7fcd901590b0 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 -- 172.21.15.42:0/2663689158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 msgr2=0x7fcd900b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 --2- 172.21.15.42:0/2663689158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd900b0070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd900cb4a0 tx=0x7fcd7c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 -- 172.21.15.42:0/2663689158 shutdown_connections 2024-08-17T02:27:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 --2- 172.21.15.42:0/2663689158 >> v2:172.21.15.62:3300/0 conn(0x7fcd900acf10 0x7fcd90159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 --2- 172.21.15.42:0/2663689158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd900b0070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 -- 172.21.15.42:0/2663689158 >> 172.21.15.42:0/2663689158 conn(0x7fcd90066e60 msgr2=0x7fcd90067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 -- 172.21.15.42:0/2663689158 shutdown_connections 2024-08-17T02:27:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.955+0000 7fcd95800640 1 -- 172.21.15.42:0/2663689158 wait complete. 2024-08-17T02:27:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.957+0000 7fcd95800640 1 Processor -- start 2024-08-17T02:27:50.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.957+0000 7fcd95800640 1 -- start start 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd95800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd900acf10 0x7fcd9016ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd95800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd900afca0 0x7fcd900c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd95800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd9015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd95800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90158210 con 0x7fcd901590b0 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd95800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901519c0 con 0x7fcd900acf10 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd95800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9016e310 con 0x7fcd900afca0 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd8f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd9015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd8e000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd900afca0 0x7fcd900c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd8ea00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd900acf10 0x7fcd9016ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd8f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd9015ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37340/0 (socket says 172.21.15.42:37340) 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd8f400640 1 -- 172.21.15.42:0/314280429 learned_addr learned my addr 172.21.15.42:0/314280429 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.958+0000 7fcd8f400640 1 -- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd900afca0 msgr2=0x7fcd900c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd8f400640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd900afca0 0x7fcd900c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd8f400640 1 -- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd900acf10 msgr2=0x7fcd9016ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd8f400640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd900acf10 0x7fcd9016ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd8f400640 1 -- 172.21.15.42:0/314280429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c009450 con 0x7fcd901590b0 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd8ea00640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd900acf10 0x7fcd9016ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd8f400640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd9015ebd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009df0 tx=0x7fcd8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800cd40 con 0x7fcd901590b0 2024-08-17T02:27:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90157f30 con 0x7fcd901590b0 2024-08-17T02:27:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8800f040 con 0x7fcd901590b0 2024-08-17T02:27:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880146d0 con 0x7fcd901590b0 2024-08-17T02:27:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.959+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9015cf60 con 0x7fcd901590b0 2024-08-17T02:27:50.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.960+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd90063fb0 con 0x7fcd901590b0 2024-08-17T02:27:50.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.961+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcd88014a80 con 0x7fcd901590b0 2024-08-17T02:27:50.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.962+0000 7fcd86000640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcd70065150 0x7fcd70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.963+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd88082e70 con 0x7fcd901590b0 2024-08-17T02:27:50.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.963+0000 7fcd8ea00640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcd70065150 0x7fcd70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.963+0000 7fcd8ea00640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcd70065150 0x7fcd70067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c83d0 tx=0x7fcd80009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:50.967+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcd88050f40 con 0x7fcd901590b0 2024-08-17T02:27:51.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.154+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd9015d150 con 0x7fcd901590b0 2024-08-17T02:27:51.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.155+0000 7fcd86000640 1 -- 172.21.15.42:0/314280429 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcd88018090 con 0x7fcd901590b0 2024-08-17T02:27:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:51.156 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:51.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcd70065150 msgr2=0x7fcd70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcd70065150 0x7fcd70067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c83d0 tx=0x7fcd80009040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 msgr2=0x7fcd9015ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd9015ebd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009df0 tx=0x7fcd8800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 shutdown_connections 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcd70065150 0x7fcd70067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd901590b0 0x7fcd9015ebd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcd900afca0 0x7fcd900c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 --2- 172.21.15.42:0/314280429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd900acf10 0x7fcd9016ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 >> 172.21.15.42:0/314280429 conn(0x7fcd90066e60 msgr2=0x7fcd900ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 shutdown_connections 2024-08-17T02:27:51.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.158+0000 7fcd95800640 1 -- 172.21.15.42:0/314280429 wait complete. 2024-08-17T02:27:51.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:51.173 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.329+0000 7f801de00640 1 Processor -- start 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.329+0000 7f801de00640 1 -- start start 2024-08-17T02:27:51.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f801de00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f801815c010 0x7f801815d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f801de00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f801815c3e0 0x7f801806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f801de00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801806ad40 con 0x7f801806b710 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f801de00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8018069e50 con 0x7f801815c010 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f801de00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801806a130 con 0x7f801815c3e0 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f8016a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f801815c010 0x7f801815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f8017400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f801806b710 0x7f80180ac480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50934/0 (socket says 172.21.15.42:50934) 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f8017400640 1 -- 172.21.15.42:0/2891192207 learned_addr learned my addr 172.21.15.42:0/2891192207 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.330+0000 7f800fe00640 1 --2- 172.21.15.42:0/2891192207 >> v2:172.21.15.62:3300/0 conn(0x7f801815c3e0 0x7f801806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.331+0000 7f8016a00640 1 -- 172.21.15.42:0/2891192207 >> v2:172.21.15.62:3300/0 conn(0x7f801815c3e0 msgr2=0x7f801806b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.331+0000 7f8016a00640 1 --2- 172.21.15.42:0/2891192207 >> v2:172.21.15.62:3300/0 conn(0x7f801815c3e0 0x7f801806b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.331+0000 7f8016a00640 1 -- 172.21.15.42:0/2891192207 >> v1:172.21.15.42:6789/0 conn(0x7f801806b710 legacy=0x7f80180ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.331+0000 7f8016000640 1 -- 172.21.15.42:0/2891192207 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389413838 0 0) 0x7f801806ad40 con 0x7f801806b710 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.331+0000 7f8016a00640 1 -- 172.21.15.42:0/2891192207 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801806a410 con 0x7f801815c010 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.332+0000 7f8016a00640 1 --2- 172.21.15.42:0/2891192207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c010 0x7f801815d250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8008009850 tx=0x7f80080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab13ac8c850eaab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.332+0000 7f8016000640 1 -- 172.21.15.42:0/2891192207 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800802ad00 con 0x7f801815c010 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.332+0000 7f8016000640 1 -- 172.21.15.42:0/2891192207 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800802ae60 con 0x7f801815c010 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.332+0000 7f8016000640 1 -- 172.21.15.42:0/2891192207 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008032670 con 0x7f801815c010 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 -- 172.21.15.42:0/2891192207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c010 msgr2=0x7f801815d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 --2- 172.21.15.42:0/2891192207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c010 0x7f801815d250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8008009850 tx=0x7f80080090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 -- 172.21.15.42:0/2891192207 shutdown_connections 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 --2- 172.21.15.42:0/2891192207 >> v2:172.21.15.62:3300/0 conn(0x7f801815c3e0 0x7f801806b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 --2- 172.21.15.42:0/2891192207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c010 0x7f801815d250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 -- 172.21.15.42:0/2891192207 >> 172.21.15.42:0/2891192207 conn(0x7f801806dda0 msgr2=0x7f80180b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 -- 172.21.15.42:0/2891192207 shutdown_connections 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.333+0000 7f801de00640 1 -- 172.21.15.42:0/2891192207 wait complete. 2024-08-17T02:27:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.334+0000 7f801de00640 1 Processor -- start 2024-08-17T02:27:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.334+0000 7f801de00640 1 -- start start 2024-08-17T02:27:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f801de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f801806b710 0x7f8018169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f801de00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f801815c010 0x7f80180ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f801de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 0x7f8018150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f801de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801814d0a0 con 0x7f801815c3e0 2024-08-17T02:27:51.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f801de00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80180cb4e0 con 0x7f801806b710 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f801de00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801814f890 con 0x7f801815c010 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f8017400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 0x7f8018150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f8017400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 0x7f8018150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37364/0 (socket says 172.21.15.42:37364) 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.335+0000 7f8017400640 1 -- 172.21.15.42:0/3787998749 learned_addr learned my addr 172.21.15.42:0/3787998749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f800fe00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f801815c010 0x7f80180ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8016a00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f801806b710 0x7f8018169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8017400640 1 -- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f801815c010 msgr2=0x7f80180ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8017400640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f801815c010 0x7f80180ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8017400640 1 -- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f801806b710 msgr2=0x7f8018169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8017400640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f801806b710 0x7f8018169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8017400640 1 -- 172.21.15.42:0/3787998749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008009390 con 0x7f801815c3e0 2024-08-17T02:27:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f8017400640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 0x7f8018150460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f801000cc90 tx=0x7f8010001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000a850 con 0x7f801815c3e0 2024-08-17T02:27:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801000a9b0 con 0x7f801815c3e0 2024-08-17T02:27:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000ad70 con 0x7f801815c3e0 2024-08-17T02:27:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.336+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801814eaf0 con 0x7f801815c3e0 2024-08-17T02:27:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.337+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801814f0b0 con 0x7f801815c3e0 2024-08-17T02:27:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.338+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8018063fb0 con 0x7f801815c3e0 2024-08-17T02:27:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.338+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8010007300 con 0x7f801815c3e0 2024-08-17T02:27:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.339+0000 7f800e000640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ff4065150 0x7f7ff4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.339+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8010082580 con 0x7f801815c3e0 2024-08-17T02:27:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.339+0000 7f8016a00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ff4065150 0x7f7ff4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.340+0000 7f8016a00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ff4065150 0x7f7ff4067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8008034000 tx=0x7f8008032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.343+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8010050700 con 0x7f801815c3e0 2024-08-17T02:27:51.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.523+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f801814e810 con 0x7f801815c3e0 2024-08-17T02:27:51.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.523+0000 7f800e000640 1 -- 172.21.15.42:0/3787998749 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8010053d20 con 0x7f801815c3e0 2024-08-17T02:27:51.524 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ff4065150 msgr2=0x7f7ff4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ff4065150 0x7f7ff4067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8008034000 tx=0x7f8008032000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 msgr2=0x7f8018150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 0x7f8018150460 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f801000cc90 tx=0x7f8010001a20 comp rx=0 tx=0).stop 2024-08-17T02:27:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 shutdown_connections 2024-08-17T02:27:51.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ff4065150 0x7f7ff4067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.525+0000 7f801de00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f801815c3e0 0x7f8018150460 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.526+0000 7f801de00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f801815c010 0x7f80180ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.526+0000 7f801de00640 1 --2- 172.21.15.42:0/3787998749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f801806b710 0x7f8018169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.526+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 >> 172.21.15.42:0/3787998749 conn(0x7f801806dda0 msgr2=0x7f80180a88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.526+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 shutdown_connections 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.526+0000 7f801de00640 1 -- 172.21.15.42:0/3787998749 wait complete. 2024-08-17T02:27:51.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.696+0000 7ff972400640 1 Processor -- start 2024-08-17T02:27:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.696+0000 7ff972400640 1 -- start start 2024-08-17T02:27:51.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.697+0000 7ff972400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff96c0afca0 0x7ff96c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.697+0000 7ff972400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0c92b0 con 0x7ff96c0acf10 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.697+0000 7ff972400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c0ad480 con 0x7ff96c1590b0 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.697+0000 7ff972400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0b0980 con 0x7ff96c0afca0 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff96c0afca0 0x7ff96c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff96c0afca0 0x7ff96c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37368/0 (socket says 172.21.15.42:37368) 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96aa00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff96c0acf10 0x7ff96c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50938/0 (socket says 172.21.15.42:50938) 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96b400640 1 -- 172.21.15.42:0/440787762 learned_addr learned my addr 172.21.15.42:0/440787762 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96b400640 1 -- 172.21.15.42:0/440787762 >> v1:172.21.15.62:6789/0 conn(0x7ff96c1590b0 legacy=0x7ff96c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96b400640 1 -- 172.21.15.42:0/440787762 >> v1:172.21.15.42:6789/0 conn(0x7ff96c0acf10 legacy=0x7ff96c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.698+0000 7ff96b400640 1 -- 172.21.15.42:0/440787762 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0ad760 con 0x7ff96c0afca0 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.699+0000 7ff96b400640 1 --2- 172.21.15.42:0/440787762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c0afca0 0x7ff96c0b0070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009910 tx=0x7ff95c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be8dca57a393917 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.699+0000 7ff96a000640 1 -- 172.21.15.42:0/440787762 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c032440 con 0x7ff96c0afca0 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.699+0000 7ff96a000640 1 -- 172.21.15.42:0/440787762 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0325a0 con 0x7ff96c0afca0 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.699+0000 7ff96a000640 1 -- 172.21.15.42:0/440787762 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c032980 con 0x7ff96c0afca0 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 -- 172.21.15.42:0/440787762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c0afca0 msgr2=0x7ff96c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 --2- 172.21.15.42:0/440787762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c0afca0 0x7ff96c0b0070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009910 tx=0x7ff95c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 -- 172.21.15.42:0/440787762 shutdown_connections 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 --2- 172.21.15.42:0/440787762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c0afca0 0x7ff96c0b0070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 -- 172.21.15.42:0/440787762 >> 172.21.15.42:0/440787762 conn(0x7ff96c066e60 msgr2=0x7ff96c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 -- 172.21.15.42:0/440787762 shutdown_connections 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.700+0000 7ff972400640 1 -- 172.21.15.42:0/440787762 wait complete. 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.701+0000 7ff972400640 1 Processor -- start 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.702+0000 7ff972400640 1 -- start start 2024-08-17T02:27:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.702+0000 7ff972400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff96c0acf10 0x7ff96c154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff972400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff96c0afca0 0x7ff96c156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff972400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 0x7ff96c156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff972400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0c5860 con 0x7ff96c1590b0 2024-08-17T02:27:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff972400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0c4c90 con 0x7ff96c0acf10 2024-08-17T02:27:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff972400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c155170 con 0x7ff96c0afca0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 0x7ff96c156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 0x7ff96c156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37384/0 (socket says 172.21.15.42:37384) 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 -- 172.21.15.42:0/365141593 learned_addr learned my addr 172.21.15.42:0/365141593 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96b400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff96c0acf10 0x7ff96c154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96aa00640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff96c0afca0 0x7ff96c156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 -- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff96c0afca0 msgr2=0x7ff96c156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff96c0afca0 0x7ff96c156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 -- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff96c0acf10 msgr2=0x7ff96c154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff96c0acf10 0x7ff96c154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.703+0000 7ff96be00640 1 -- 172.21.15.42:0/365141593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009450 con 0x7ff96c1590b0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.704+0000 7ff96be00640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 0x7ff96c156dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c7c0 tx=0x7ff9640015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.704+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400a640 con 0x7ff96c1590b0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.704+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96400a7c0 con 0x7ff96c1590b0 2024-08-17T02:27:51.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.704+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400ab80 con 0x7ff96c1590b0 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.704+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c0c4f30 con 0x7ff96c1590b0 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.704+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c0c54f0 con 0x7ff96c1590b0 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.705+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c0c59d0 con 0x7ff96c1590b0 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.706+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff964012420 con 0x7ff96c1590b0 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.707+0000 7ff962a00640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff94c065150 0x7ff94c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.707+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff964082550 con 0x7ff96c1590b0 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.707+0000 7ff96b400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff94c065150 0x7ff94c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.708+0000 7ff96b400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff94c065150 0x7ff94c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff95c034000 tx=0x7ff95c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.711+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff964050620 con 0x7ff96c1590b0 2024-08-17T02:27:51.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.893+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff96c063fb0 con 0x7ff96c1590b0 2024-08-17T02:27:51.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.894+0000 7ff962a00640 1 -- 172.21.15.42:0/365141593 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff964053c40 con 0x7ff96c1590b0 2024-08-17T02:27:51.894 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff94c065150 msgr2=0x7ff94c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff94c065150 0x7ff94c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff95c034000 tx=0x7ff95c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 msgr2=0x7ff96c156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 0x7ff96c156dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c7c0 tx=0x7ff9640015b0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 shutdown_connections 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff94c065150 0x7ff94c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff96c1590b0 0x7ff96c156dd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff96c0afca0 0x7ff96c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 --2- 172.21.15.42:0/365141593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff96c0acf10 0x7ff96c154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 >> 172.21.15.42:0/365141593 conn(0x7ff96c066e60 msgr2=0x7ff96c158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 shutdown_connections 2024-08-17T02:27:51.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:51.896+0000 7ff972400640 1 -- 172.21.15.42:0/365141593 wait complete. 2024-08-17T02:27:51.911 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.064+0000 7f91e5000640 1 Processor -- start 2024-08-17T02:27:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.064+0000 7f91e5000640 1 -- start start 2024-08-17T02:27:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91e5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e00aab40 0x7f91e00a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91e5000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00a88e0 con 0x7f91e015a4d0 2024-08-17T02:27:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91e5000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00a9180 con 0x7f91e0158bf0 2024-08-17T02:27:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91e5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e015a0e0 con 0x7f91e00aab40 2024-08-17T02:27:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91de800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f91e015a4d0 0x7f91e015a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50940/0 (socket says 172.21.15.42:50940) 2024-08-17T02:27:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91de800640 1 -- 172.21.15.42:0/718923936 learned_addr learned my addr 172.21.15.42:0/718923936 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91d7e00640 1 --2- 172.21.15.42:0/718923936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e00aab40 0x7f91e00a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243064740 0 0) 0x7f91e00a88e0 con 0x7f91e015a4d0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.066+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c40034e0 con 0x7f91e015a4d0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.067+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183859600 0 0) 0x7f91e00a9180 con 0x7f91e0158bf0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.067+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e00a88e0 con 0x7f91e0158bf0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.067+0000 7f91d7e00640 1 -- 172.21.15.42:0/718923936 >> v1:172.21.15.62:6789/0 conn(0x7f91e0158bf0 legacy=0x7f91e00aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.067+0000 7f91d7e00640 1 -- 172.21.15.42:0/718923936 >> v1:172.21.15.42:6789/0 conn(0x7f91e015a4d0 legacy=0x7f91e015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.067+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 235045870 0 0) 0x7f91c40034e0 con 0x7f91e015a4d0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.067+0000 7f91d7e00640 1 -- 172.21.15.42:0/718923936 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00a8b30 con 0x7f91e00aab40 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.068+0000 7f91d7e00640 1 --2- 172.21.15.42:0/718923936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e00aab40 0x7f91e00a9610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009880 tx=0x7f91c80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1986b972d1d7d014 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.068+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80017f0 con 0x7f91e00aab40 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.068+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c802aac0 con 0x7f91e00aab40 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.068+0000 7f91dd400640 1 -- 172.21.15.42:0/718923936 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c802ae60 con 0x7f91e00aab40 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 -- 172.21.15.42:0/718923936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e00aab40 msgr2=0x7f91e00a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 --2- 172.21.15.42:0/718923936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e00aab40 0x7f91e00a9610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009880 tx=0x7f91c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 -- 172.21.15.42:0/718923936 shutdown_connections 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 --2- 172.21.15.42:0/718923936 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e00aab40 0x7f91e00a9610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 -- 172.21.15.42:0/718923936 >> 172.21.15.42:0/718923936 conn(0x7f91e0066e60 msgr2=0x7f91e0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 -- 172.21.15.42:0/718923936 shutdown_connections 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.069+0000 7f91e5000640 1 -- 172.21.15.42:0/718923936 wait complete. 2024-08-17T02:27:52.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.070+0000 7f91e5000640 1 Processor -- start 2024-08-17T02:27:52.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.070+0000 7f91e5000640 1 -- start start 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91e5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 0x7f91e00cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91e5000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91e0158bf0 0x7f91e00adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91e5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e015a4d0 0x7f91e00b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91e5000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0169a60 con 0x7f91e00aab40 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91e5000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00b1f40 con 0x7f91e0158bf0 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91e5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00cb370 con 0x7f91e015a4d0 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.071+0000 7f91dde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 0x7f91e00cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 0x7f91e00cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37398/0 (socket says 172.21.15.42:37398) 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 -- 172.21.15.42:0/1349407791 learned_addr learned my addr 172.21.15.42:0/1349407791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91d7e00640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91e0158bf0 0x7f91e00adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91de800640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e015a4d0 0x7f91e00b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 -- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e015a4d0 msgr2=0x7f91e00b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e015a4d0 0x7f91e00b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 -- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91e0158bf0 msgr2=0x7f91e00adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91e0158bf0 0x7f91e00adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 -- 172.21.15.42:0/1349407791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009390 con 0x7f91e00aab40 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.072+0000 7f91dde00640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 0x7f91e00cae30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c590 tx=0x7f91d0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.073+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0012630 con 0x7f91e00aab40 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.073+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d00127b0 con 0x7f91e00aab40 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.073+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0012bb0 con 0x7f91e00aab40 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.073+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00cb630 con 0x7f91e00aab40 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.073+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e0169410 con 0x7f91e00aab40 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.074+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e0063fb0 con 0x7f91e00aab40 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.075+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f91d001a3b0 con 0x7f91e00aab40 2024-08-17T02:27:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.075+0000 7f91d5600640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91bc065150 0x7f91bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.075+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91d00822b0 con 0x7f91e00aab40 2024-08-17T02:27:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.076+0000 7f91d7e00640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91bc065150 0x7f91bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.076+0000 7f91d7e00640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91bc065150 0x7f91bc067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91c8034000 tx=0x7f91c8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.079+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f91d0050380 con 0x7f91e00aab40 2024-08-17T02:27:52.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.261+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91e015b690 con 0x7f91e00aab40 2024-08-17T02:27:52.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.261+0000 7f91d5600640 1 -- 172.21.15.42:0/1349407791 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91d00539a0 con 0x7f91e00aab40 2024-08-17T02:27:52.262 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91bc065150 msgr2=0x7f91bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91bc065150 0x7f91bc067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f91c8034000 tx=0x7f91c8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 msgr2=0x7f91e00cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 0x7f91e00cae30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c590 tx=0x7f91d0007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 shutdown_connections 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f91bc065150 0x7f91bc067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91e015a4d0 0x7f91e00b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91e0158bf0 0x7f91e00adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 --2- 172.21.15.42:0/1349407791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e00aab40 0x7f91e00cae30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 >> 172.21.15.42:0/1349407791 conn(0x7f91e0066e60 msgr2=0x7f91e0155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 shutdown_connections 2024-08-17T02:27:52.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.263+0000 7f91e5000640 1 -- 172.21.15.42:0/1349407791 wait complete. 2024-08-17T02:27:52.279 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:52.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.429+0000 7fa71c800640 1 Processor -- start 2024-08-17T02:27:52.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.429+0000 7fa71c800640 1 -- start start 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.430+0000 7fa71c800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa71415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.430+0000 7fa71c800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71415b5e0 con 0x7fa7140ca050 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.430+0000 7fa71c800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7140cb160 con 0x7fa7140add30 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.430+0000 7fa71c800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140b0d10 con 0x7fa7140ad960 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa719400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa7140ca050 0x7fa714156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50954/0 (socket says 172.21.15.42:50954) 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa719400640 1 -- 172.21.15.42:0/1078314703 learned_addr learned my addr 172.21.15.42:0/1078314703 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:52.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa719e00640 1 --2- 172.21.15.42:0/1078314703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa71415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951993869 0 0) 0x7fa704001110 con 0x7fa7140ca050 2024-08-17T02:27:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6fc0034e0 con 0x7fa7140ca050 2024-08-17T02:27:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638492281 0 0) 0x7fa7140cb160 con 0x7fa7140add30 2024-08-17T02:27:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa704001110 con 0x7fa7140add30 2024-08-17T02:27:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa719e00640 1 -- 172.21.15.42:0/1078314703 >> v1:172.21.15.62:6789/0 conn(0x7fa7140add30 legacy=0x7fa7140aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa719e00640 1 -- 172.21.15.42:0/1078314703 >> v1:172.21.15.42:6789/0 conn(0x7fa7140ca050 legacy=0x7fa714156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.431+0000 7fa719e00640 1 -- 172.21.15.42:0/1078314703 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140ca550 con 0x7fa7140ad960 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.432+0000 7fa719e00640 1 --2- 172.21.15.42:0/1078314703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa71415b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa708009880 tx=0x7fa7080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1195e902cbbc879 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.433+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70802aea0 con 0x7fa7140ad960 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.433+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708032440 con 0x7fa7140ad960 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.433+0000 7fa718a00640 1 -- 172.21.15.42:0/1078314703 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080327e0 con 0x7fa7140ad960 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.433+0000 7fa71c800640 1 -- 172.21.15.42:0/1078314703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 msgr2=0x7fa71415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.433+0000 7fa71c800640 1 --2- 172.21.15.42:0/1078314703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa71415b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa708009880 tx=0x7fa7080090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.434+0000 7fa71c800640 1 -- 172.21.15.42:0/1078314703 shutdown_connections 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.434+0000 7fa71c800640 1 --2- 172.21.15.42:0/1078314703 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa71415b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.434+0000 7fa71c800640 1 -- 172.21.15.42:0/1078314703 >> 172.21.15.42:0/1078314703 conn(0x7fa714066e60 msgr2=0x7fa714067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.434+0000 7fa71c800640 1 -- 172.21.15.42:0/1078314703 shutdown_connections 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.434+0000 7fa71c800640 1 -- 172.21.15.42:0/1078314703 wait complete. 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.435+0000 7fa71c800640 1 Processor -- start 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.435+0000 7fa71c800640 1 -- start start 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71c800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa714140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71c800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7140add30 0x7fa71416ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71c800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7140ca050 0x7fa71416d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71c800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71413ea60 con 0x7fa7140ca050 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71c800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714140a80 con 0x7fa7140add30 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71c800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7141400b0 con 0x7fa7140ad960 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa719e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa714140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa71a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7140ca050 0x7fa71416d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa719400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7140add30 0x7fa71416ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.436+0000 7fa719e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa714140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54404/0 (socket says 172.21.15.42:54404) 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 -- 172.21.15.42:0/671516565 learned_addr learned my addr 172.21.15.42:0/671516565 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:52.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 -- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7140add30 msgr2=0x7fa71416ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7140add30 0x7fa71416ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 -- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7140ca050 msgr2=0x7fa71416d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7140ca050 0x7fa71416d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 -- 172.21.15.42:0/671516565 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708009390 con 0x7fa7140ad960 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa71a800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7140ca050 0x7fa71416d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.437+0000 7fa719e00640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa714140540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa708009880 tx=0x7fa708032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.438+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70802aea0 con 0x7fa7140ad960 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.438+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa708000c40 con 0x7fa7140ad960 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.438+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71413f780 con 0x7fa7140ad960 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.438+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708031cb0 con 0x7fa7140ad960 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.438+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71413fd40 con 0x7fa7140ad960 2024-08-17T02:27:52.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.439+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa714063fb0 con 0x7fa7140ad960 2024-08-17T02:27:52.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.440+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa708039040 con 0x7fa7140ad960 2024-08-17T02:27:52.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.441+0000 7fa70d600640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa6f8065150 0x7fa6f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.441+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa708041030 con 0x7fa7140ad960 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.441+0000 7fa719400640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa6f8065150 0x7fa6f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.442+0000 7fa719400640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa6f8065150 0x7fa6f8067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa714153e70 tx=0x7fa704009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.445+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa708070bc0 con 0x7fa7140ad960 2024-08-17T02:27:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.629+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7140cc2a0 con 0x7fa7140ad960 2024-08-17T02:27:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.630+0000 7fa70d600640 1 -- 172.21.15.42:0/671516565 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fa70804b090 con 0x7fa7140ad960 2024-08-17T02:27:52.631 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:52.631 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.632+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa6f8065150 msgr2=0x7fa6f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.632+0000 7fa71c800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa6f8065150 0x7fa6f8067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa714153e70 tx=0x7fa704009040 comp rx=0 tx=0).stop 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.632+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 msgr2=0x7fa714140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.632+0000 7fa71c800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa714140540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa708009880 tx=0x7fa708032000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 shutdown_connections 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa6f8065150 0x7fa6f8067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7140ca050 0x7fa71416d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7140add30 0x7fa71416ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 --2- 172.21.15.42:0/671516565 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7140ad960 0x7fa714140540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 >> 172.21.15.42:0/671516565 conn(0x7fa714066e60 msgr2=0x7fa714155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 shutdown_connections 2024-08-17T02:27:52.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.633+0000 7fa71c800640 1 -- 172.21.15.42:0/671516565 wait complete. 2024-08-17T02:27:52.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:52.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.802+0000 7fa9ebe00640 1 Processor -- start 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.802+0000 7fa9ebe00640 1 -- start start 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9ebe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9ebe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9ec0cd780 0x7fa9ec0cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9ebe00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec0cdc60 con 0x7fa9ec15bbd0 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9ebe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec0cdf40 con 0x7fa9ec0cd780 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9ebe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0ce220 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9e3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9ec0cd780 0x7fa9ec0cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9eb400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa9ec15bbd0 0x7fa9ec15c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50970/0 (socket says 172.21.15.42:50970) 2024-08-17T02:27:52.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9eb400640 1 -- 172.21.15.42:0/744067235 learned_addr learned my addr 172.21.15.42:0/744067235 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:52.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9eaa00640 1 --2- 172.21.15.42:0/744067235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9e3e00640 1 -- 172.21.15.42:0/744067235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec0cc7e0 msgr2=0x7fa9ec0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9e3e00640 1 --2- 172.21.15.42:0/744067235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9e3e00640 1 -- 172.21.15.42:0/744067235 >> v1:172.21.15.42:6789/0 conn(0x7fa9ec15bbd0 legacy=0x7fa9ec15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.805+0000 7fa9e3e00640 1 -- 172.21.15.42:0/744067235 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0ce500 con 0x7fa9ec0cd780 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.804+0000 7fa9ea000640 1 -- 172.21.15.42:0/744067235 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138537286 0 0) 0x7fa9ec0cdc60 con 0x7fa9ec15bbd0 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.805+0000 7fa9e3e00640 1 --2- 172.21.15.42:0/744067235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0cab20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009850 tx=0x7fa9d40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f21c7b148f3ef65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ea000640 1 -- 172.21.15.42:0/744067235 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d402ae10 con 0x7fa9ec0cd780 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ea000640 1 -- 172.21.15.42:0/744067235 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4032440 con 0x7fa9ec0cd780 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ea000640 1 -- 172.21.15.42:0/744067235 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40327e0 con 0x7fa9ec0cd780 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 -- 172.21.15.42:0/744067235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cd780 msgr2=0x7fa9ec0cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/744067235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0cab20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009850 tx=0x7fa9d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 -- 172.21.15.42:0/744067235 shutdown_connections 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/744067235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0cab20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/744067235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 -- 172.21.15.42:0/744067235 >> 172.21.15.42:0/744067235 conn(0x7fa9ec087a80 msgr2=0x7fa9ec06e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.806+0000 7fa9ebe00640 1 -- 172.21.15.42:0/744067235 shutdown_connections 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.807+0000 7fa9ebe00640 1 -- 172.21.15.42:0/744067235 wait complete. 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.808+0000 7fa9ebe00640 1 Processor -- start 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.808+0000 7fa9ebe00640 1 -- start start 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9ebe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9ebe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec15bbd0 0x7fa9ec1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9ebe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0c9460 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9ebe00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0b2fe0 con 0x7fa9ec0cd780 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9ebe00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0b32c0 con 0x7fa9ec15bbd0 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9eaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9eaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37420/0 (socket says 172.21.15.42:37420) 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9eaa00640 1 -- 172.21.15.42:0/699503856 learned_addr learned my addr 172.21.15.42:0/699503856 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9e3e00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.809+0000 7fa9eb400640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec15bbd0 0x7fa9ec1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9eaa00640 1 -- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec15bbd0 msgr2=0x7fa9ec1564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9eaa00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec15bbd0 0x7fa9ec1564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9eaa00640 1 -- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9ec0cd780 msgr2=0x7fa9ec0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9eaa00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9eaa00640 1 -- 172.21.15.42:0/699503856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009390 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9eaa00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0b2950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00d890 tx=0x7fa9dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00de20 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00b8d0 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00bc70 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ec0b35a0 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.810+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec0b3b60 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.811+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec070720 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.812+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa9dc014640 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.813+0000 7fa9e2000640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9c8065150 0x7fa9c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.814+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9dc082a00 con 0x7fa9ec0cc7e0 2024-08-17T02:27:52.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.814+0000 7fa9e3e00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9c8065150 0x7fa9c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.815+0000 7fa9e3e00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9c8065150 0x7fa9c8067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4034000 tx=0x7fa9d4032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:52.818+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9dc050b90 con 0x7fa9ec0cc7e0 2024-08-17T02:27:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.001+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9ec0c5960 con 0x7fa9ec0cc7e0 2024-08-17T02:27:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.002+0000 7fa9e2000640 1 -- 172.21.15.42:0/699503856 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9dc0541b0 con 0x7fa9ec0cc7e0 2024-08-17T02:27:53.002 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9c8065150 msgr2=0x7fa9c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9c8065150 0x7fa9c8067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4034000 tx=0x7fa9d4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 msgr2=0x7fa9ec0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0b2950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00d890 tx=0x7fa9dc008040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 shutdown_connections 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9c8065150 0x7fa9c8067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa9ec15bbd0 0x7fa9ec1564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9ec0cd780 0x7fa9ec0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 --2- 172.21.15.42:0/699503856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9ec0cc7e0 0x7fa9ec0b2950 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 >> 172.21.15.42:0/699503856 conn(0x7fa9ec087a80 msgr2=0x7fa9ec0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.004+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 shutdown_connections 2024-08-17T02:27:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.005+0000 7fa9ebe00640 1 -- 172.21.15.42:0/699503856 wait complete. 2024-08-17T02:27:53.020 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:53.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.173+0000 7f052e600640 1 Processor -- start 2024-08-17T02:27:53.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.173+0000 7f052e600640 1 -- start start 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f052e600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0528158b90 0x7f05280b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f052e600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05280af130 0x7f05280ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f052e600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280afd20 con 0x7f05280b2370 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f052e600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05280affe0 con 0x7f0528158b90 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f052e600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05280b02c0 con 0x7f05280af130 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f0527400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0528158b90 0x7f05280b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f0527400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0528158b90 0x7f05280b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37436/0 (socket says 172.21.15.42:37436) 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.174+0000 7f0527400640 1 -- 172.21.15.42:0/237722974 learned_addr learned my addr 172.21.15.42:0/237722974 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.175+0000 7f0527e00640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05280af130 0x7f05280ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.175+0000 7f0527400640 1 -- 172.21.15.42:0/237722974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05280af130 msgr2=0x7f05280ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.175+0000 7f0527400640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05280af130 0x7f05280ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.175+0000 7f0527400640 1 -- 172.21.15.42:0/237722974 >> v1:172.21.15.62:6789/0 conn(0x7f05280b2370 legacy=0x7f05280aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.175+0000 7f0527400640 1 -- 172.21.15.42:0/237722974 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280ca3c0 con 0x7f0528158b90 2024-08-17T02:27:53.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.175+0000 7f0527e00640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05280af130 0x7f05280ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:53.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.176+0000 7f0527400640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0528158b90 0x7f05280b1e30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0518009910 tx=0x7f05180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b679f0fd2593e87f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.176+0000 7f0526000640 1 -- 172.21.15.42:0/237722974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051802adb0 con 0x7f0528158b90 2024-08-17T02:27:53.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.176+0000 7f0526000640 1 -- 172.21.15.42:0/237722974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518032440 con 0x7f0528158b90 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.176+0000 7f0526000640 1 -- 172.21.15.42:0/237722974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518032820 con 0x7f0528158b90 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 -- 172.21.15.42:0/237722974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0528158b90 msgr2=0x7f05280b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0528158b90 0x7f05280b1e30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0518009910 tx=0x7f05180091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 -- 172.21.15.42:0/237722974 shutdown_connections 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05280af130 0x7f05280ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 --2- 172.21.15.42:0/237722974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0528158b90 0x7f05280b1e30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 -- 172.21.15.42:0/237722974 >> 172.21.15.42:0/237722974 conn(0x7f052806e590 msgr2=0x7f052806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 -- 172.21.15.42:0/237722974 shutdown_connections 2024-08-17T02:27:53.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.177+0000 7f052e600640 1 -- 172.21.15.42:0/237722974 wait complete. 2024-08-17T02:27:53.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.178+0000 7f052e600640 1 Processor -- start 2024-08-17T02:27:53.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.178+0000 7f052e600640 1 -- start start 2024-08-17T02:27:53.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f052e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 0x7f052814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f052e600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05280b2370 0x7f052815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f052e600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0528158b90 0x7f052815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f052e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280c6d20 con 0x7f05280af130 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f052e600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280c72e0 con 0x7f05280b2370 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f052e600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0528159c50 con 0x7f0528158b90 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.179+0000 7f0527400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 0x7f052814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 0x7f052814b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37444/0 (socket says 172.21.15.42:37444) 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 -- 172.21.15.42:0/995463354 learned_addr learned my addr 172.21.15.42:0/995463354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 -- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0528158b90 msgr2=0x7f052815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527e00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0528158b90 0x7f052815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0526a00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05280b2370 0x7f052815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0528158b90 0x7f052815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 -- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05280b2370 msgr2=0x7f052815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05280b2370 0x7f052815abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 -- 172.21.15.42:0/995463354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0518009450 con 0x7f05280af130 2024-08-17T02:27:53.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527e00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0528158b90 0x7f052815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:53.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0526a00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05280b2370 0x7f052815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:53.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.180+0000 7f0527400640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 0x7f052814b040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0518009970 tx=0x7f0518032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.181+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518031de0 con 0x7f05280af130 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.181+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051803d420 con 0x7f05280af130 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.181+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051803d820 con 0x7f05280af130 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.181+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0528159f30 con 0x7f05280af130 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.181+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052814b580 con 0x7f05280af130 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.182+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0528064780 con 0x7f05280af130 2024-08-17T02:27:53.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.183+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0518039040 con 0x7f05280af130 2024-08-17T02:27:53.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.183+0000 7f051ea00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0508065180 0x7f0508067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.184+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05180a2830 con 0x7f05280af130 2024-08-17T02:27:53.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.184+0000 7f0526a00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0508065180 0x7f0508067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.184+0000 7f0526a00640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0508065180 0x7f0508067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05280cc000 tx=0x7f0514009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.188+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0518070850 con 0x7f05280af130 2024-08-17T02:27:53.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.368+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0528063fb0 con 0x7f05280af130 2024-08-17T02:27:53.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.369+0000 7f051ea00640 1 -- 172.21.15.42:0/995463354 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0518073e70 con 0x7f05280af130 2024-08-17T02:27:53.369 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:53.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0508065180 msgr2=0x7f0508067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0508065180 0x7f0508067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05280cc000 tx=0x7f0514009040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 msgr2=0x7f052814b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 0x7f052814b040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0518009970 tx=0x7f0518032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 shutdown_connections 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0508065180 0x7f0508067630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0528158b90 0x7f052815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05280b2370 0x7f052815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 --2- 172.21.15.42:0/995463354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05280af130 0x7f052814b040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 >> 172.21.15.42:0/995463354 conn(0x7f052806e590 msgr2=0x7f05280ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 shutdown_connections 2024-08-17T02:27:53.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.371+0000 7f052e600640 1 -- 172.21.15.42:0/995463354 wait complete. 2024-08-17T02:27:53.386 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.540+0000 7f0352200640 1 Processor -- start 2024-08-17T02:27:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.540+0000 7f0352200640 1 -- start start 2024-08-17T02:27:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0352200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0ab100 0x7f034c0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0352200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0352200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c156fc0 con 0x7f034c0aa620 2024-08-17T02:27:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0352200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c158450 con 0x7f034c0b1f30 2024-08-17T02:27:53.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0352200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c1586f0 con 0x7f034c0ab100 2024-08-17T02:27:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0350e00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f034c0aa620 0x7f034c0aa9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:34692/0 (socket says 172.21.15.42:34692) 2024-08-17T02:27:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0350e00640 1 -- 172.21.15.42:0/379715238 learned_addr learned my addr 172.21.15.42:0/379715238 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f034be00640 1 --2- 172.21.15.42:0/379715238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0ab100 0x7f034c0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.542+0000 7f0351800640 1 --2- 172.21.15.42:0/379715238 >> v2:172.21.15.62:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.543+0000 7f034be00640 1 -- 172.21.15.42:0/379715238 >> v2:172.21.15.62:3300/0 conn(0x7f034c0b1f30 msgr2=0x7f034c0b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.543+0000 7f034be00640 1 --2- 172.21.15.42:0/379715238 >> v2:172.21.15.62:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.543+0000 7f034be00640 1 -- 172.21.15.42:0/379715238 >> v1:172.21.15.62:6789/0 conn(0x7f034c0aa620 legacy=0x7f034c0aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.543+0000 7f034be00640 1 -- 172.21.15.42:0/379715238 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0b2a20 con 0x7f034c0ab100 2024-08-17T02:27:53.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.544+0000 7f034be00640 1 --2- 172.21.15.42:0/379715238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0ab100 0x7f034c0b19f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0338009850 tx=0x7f03380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7c1d9775054d351 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.545+0000 7f034b400640 1 -- 172.21.15.42:0/379715238 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033802ad90 con 0x7f034c0ab100 2024-08-17T02:27:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.545+0000 7f034b400640 1 -- 172.21.15.42:0/379715238 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338032440 con 0x7f034c0ab100 2024-08-17T02:27:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.545+0000 7f034b400640 1 -- 172.21.15.42:0/379715238 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338032820 con 0x7f034c0ab100 2024-08-17T02:27:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 -- 172.21.15.42:0/379715238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0ab100 msgr2=0x7f034c0b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 --2- 172.21.15.42:0/379715238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0ab100 0x7f034c0b19f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0338009850 tx=0x7f03380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 -- 172.21.15.42:0/379715238 shutdown_connections 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 --2- 172.21.15.42:0/379715238 >> v2:172.21.15.62:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 --2- 172.21.15.42:0/379715238 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0ab100 0x7f034c0b19f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 -- 172.21.15.42:0/379715238 >> 172.21.15.42:0/379715238 conn(0x7f034c0ce400 msgr2=0x7f034c095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 -- 172.21.15.42:0/379715238 shutdown_connections 2024-08-17T02:27:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.546+0000 7f0352200640 1 -- 172.21.15.42:0/379715238 wait complete. 2024-08-17T02:27:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.548+0000 7f0352200640 1 Processor -- start 2024-08-17T02:27:53.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.548+0000 7f0352200640 1 -- start start 2024-08-17T02:27:53.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0352200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 0x7f034c09b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0352200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f034c0ab100 0x7f034c169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0352200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f034c0b1f30 0x7f034c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0352200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c099e70 con 0x7f034c0b1f30 2024-08-17T02:27:53.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0352200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c09ad90 con 0x7f034c0ab100 2024-08-17T02:27:53.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0352200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c155d00 con 0x7f034c0aa620 2024-08-17T02:27:53.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0351800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f034c0b1f30 0x7f034c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 0x7f034c09b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 0x7f034c09b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54448/0 (socket says 172.21.15.42:54448) 2024-08-17T02:27:53.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 -- 172.21.15.42:0/371255286 learned_addr learned my addr 172.21.15.42:0/371255286 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:53.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f034be00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f034c0ab100 0x7f034c169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 -- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f034c0ab100 msgr2=0x7f034c169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f034c0ab100 0x7f034c169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 -- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f034c0b1f30 msgr2=0x7f034c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f034c0b1f30 0x7f034c1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.549+0000 7f0350e00640 1 -- 172.21.15.42:0/371255286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338009390 con 0x7f034c0aa620 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f0351800640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f034c0b1f30 0x7f034c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f0350e00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 0x7f034c09b220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f034000c560 tx=0x7f0340007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340005aa0 con 0x7f034c0aa620 2024-08-17T02:27:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340005c20 con 0x7f034c0aa620 2024-08-17T02:27:53.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340007320 con 0x7f034c0aa620 2024-08-17T02:27:53.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c09a180 con 0x7f034c0aa620 2024-08-17T02:27:53.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.550+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c09a740 con 0x7f034c0aa620 2024-08-17T02:27:53.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.551+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c070720 con 0x7f034c0aa620 2024-08-17T02:27:53.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.552+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f034001b3b0 con 0x7f034c0aa620 2024-08-17T02:27:53.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.553+0000 7f033fe00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f032c065180 0x7f032c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.553+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0340081640 con 0x7f034c0aa620 2024-08-17T02:27:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.553+0000 7f034be00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f032c065180 0x7f032c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.554+0000 7f034be00640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f032c065180 0x7f032c067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0338034000 tx=0x7f0338032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.558+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f034004f710 con 0x7f034c0aa620 2024-08-17T02:27:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.740+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f034c156fc0 con 0x7f034c0aa620 2024-08-17T02:27:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.740+0000 7f033fe00640 1 -- 172.21.15.42:0/371255286 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f034c156fc0 con 0x7f034c0aa620 2024-08-17T02:27:53.741 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f032c065180 msgr2=0x7f032c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f032c065180 0x7f032c067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0338034000 tx=0x7f0338032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 msgr2=0x7f034c09b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 0x7f034c09b220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f034000c560 tx=0x7f0340007f40 comp rx=0 tx=0).stop 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 shutdown_connections 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f032c065180 0x7f032c067630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f034c0b1f30 0x7f034c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f034c0ab100 0x7f034c169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.742+0000 7f0352200640 1 --2- 172.21.15.42:0/371255286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f034c0aa620 0x7f034c09b220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.743+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 >> 172.21.15.42:0/371255286 conn(0x7f034c0ce400 msgr2=0x7f034c06c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.743+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 shutdown_connections 2024-08-17T02:27:53.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.743+0000 7f0352200640 1 -- 172.21.15.42:0/371255286 wait complete. 2024-08-17T02:27:53.758 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:53.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.909+0000 7f1d5a200640 1 Processor -- start 2024-08-17T02:27:53.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.909+0000 7f1d5a200640 1 -- start start 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d5a200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d540afca0 0x7f1d540b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d5a200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d540acf10 0x7f1d54159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d5a200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5415a4e0 con 0x7f1d541589a0 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d5a200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d540b0980 con 0x7f1d540acf10 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d5a200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d540c92b0 con 0x7f1d540afca0 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d540acf10 0x7f1d54159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d540acf10 0x7f1d54159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37448/0 (socket says 172.21.15.42:37448) 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 -- 172.21.15.42:0/979575109 learned_addr learned my addr 172.21.15.42:0/979575109 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:53.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d53400640 1 --2- 172.21.15.42:0/979575109 >> v2:172.21.15.62:3300/0 conn(0x7f1d540afca0 0x7f1d540b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 -- 172.21.15.42:0/979575109 >> v2:172.21.15.62:3300/0 conn(0x7f1d540afca0 msgr2=0x7f1d540b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 --2- 172.21.15.42:0/979575109 >> v2:172.21.15.62:3300/0 conn(0x7f1d540afca0 0x7f1d540b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 -- 172.21.15.42:0/979575109 >> v1:172.21.15.62:6789/0 conn(0x7f1d541589a0 legacy=0x7f1d54158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.911+0000 7f1d4be00640 1 -- 172.21.15.42:0/979575109 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540ad480 con 0x7f1d540acf10 2024-08-17T02:27:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.912+0000 7f1d4be00640 1 --2- 172.21.15.42:0/979575109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540acf10 0x7f1d54159fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1d54067e40 tx=0x7f1d3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac77a77f16a437 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d52a00640 1 -- 172.21.15.42:0/979575109 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c02ae80 con 0x7f1d540acf10 2024-08-17T02:27:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d52a00640 1 -- 172.21.15.42:0/979575109 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c032440 con 0x7f1d540acf10 2024-08-17T02:27:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d52a00640 1 -- 172.21.15.42:0/979575109 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c032800 con 0x7f1d540acf10 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 -- 172.21.15.42:0/979575109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540acf10 msgr2=0x7f1d54159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 --2- 172.21.15.42:0/979575109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540acf10 0x7f1d54159fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1d54067e40 tx=0x7f1d3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 -- 172.21.15.42:0/979575109 shutdown_connections 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 --2- 172.21.15.42:0/979575109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540acf10 0x7f1d54159fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 --2- 172.21.15.42:0/979575109 >> v2:172.21.15.62:3300/0 conn(0x7f1d540afca0 0x7f1d540b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 -- 172.21.15.42:0/979575109 >> 172.21.15.42:0/979575109 conn(0x7f1d54066e60 msgr2=0x7f1d54067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 -- 172.21.15.42:0/979575109 shutdown_connections 2024-08-17T02:27:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.913+0000 7f1d5a200640 1 -- 172.21.15.42:0/979575109 wait complete. 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.915+0000 7f1d5a200640 1 Processor -- start 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.915+0000 7f1d5a200640 1 -- start start 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d5a200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d540acf10 0x7f1d54151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d5a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 0x7f1d5414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d5a200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d541589a0 0x7f1d54149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d5a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5414b130 con 0x7f1d540afca0 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d5a200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5414a520 con 0x7f1d541589a0 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d5a200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5414a800 con 0x7f1d540acf10 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 0x7f1d5414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 0x7f1d5414b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37456/0 (socket says 172.21.15.42:37456) 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d4be00640 1 -- 172.21.15.42:0/631632002 learned_addr learned my addr 172.21.15.42:0/631632002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d53400640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d540acf10 0x7f1d54151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.916+0000 7f1d53e00640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d541589a0 0x7f1d54149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4be00640 1 -- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d540acf10 msgr2=0x7f1d54151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4be00640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d540acf10 0x7f1d54151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4be00640 1 -- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d541589a0 msgr2=0x7f1d54149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4be00640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d541589a0 0x7f1d54149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4be00640 1 -- 172.21.15.42:0/631632002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c009450 con 0x7f1d540afca0 2024-08-17T02:27:53.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4be00640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 0x7f1d5414b5c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009210 tx=0x7f1d3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c031c80 con 0x7f1d540afca0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c031e00 con 0x7f1d540afca0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c03d670 con 0x7f1d540afca0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5414aae0 con 0x7f1d540afca0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.917+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d541524a0 con 0x7f1d540afca0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.919+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5414b2e0 con 0x7f1d540afca0 2024-08-17T02:27:53.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.919+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1d3c039040 con 0x7f1d540afca0 2024-08-17T02:27:53.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.920+0000 7f1d4aa00640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.920+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d3c0a2260 con 0x7f1d540afca0 2024-08-17T02:27:53.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.920+0000 7f1d53400640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.921+0000 7f1d53400640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d5416c870 tx=0x7f1d440090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:53.924+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d5414b2e0 con 0x7f1d540afca0 2024-08-17T02:27:54.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.108+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d54063fb0 con 0x7f1d540afca0 2024-08-17T02:27:54.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.108+0000 7f1d4aa00640 1 -- 172.21.15.42:0/631632002 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f1d3c0703d0 con 0x7f1d540afca0 2024-08-17T02:27:54.109 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:54.109 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:54.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.110+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 msgr2=0x7f1d30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.110+0000 7f1d5a200640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d5416c870 tx=0x7f1d440090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.110+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 msgr2=0x7f1d5414b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.110+0000 7f1d5a200640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 0x7f1d5414b5c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009210 tx=0x7f1d3c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:54.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 shutdown_connections 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d541589a0 0x7f1d54149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d540afca0 0x7f1d5414b5c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 --2- 172.21.15.42:0/631632002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d540acf10 0x7f1d54151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 >> 172.21.15.42:0/631632002 conn(0x7f1d54066e60 msgr2=0x7f1d54159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 shutdown_connections 2024-08-17T02:27:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.111+0000 7f1d5a200640 1 -- 172.21.15.42:0/631632002 wait complete. 2024-08-17T02:27:54.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:54.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:54.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.279+0000 7fb7b5200640 1 Processor -- start 2024-08-17T02:27:54.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.280+0000 7fb7b5200640 1 -- start start 2024-08-17T02:27:54.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7b5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 0x7fb7b015af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7b5200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00ae060 con 0x7fb7b00b10e0 2024-08-17T02:27:54.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7b5200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b00c9ce0 con 0x7fb7b014d780 2024-08-17T02:27:54.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7b5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015b440 con 0x7fb7b014db50 2024-08-17T02:27:54.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7afe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb7b00b10e0 0x7fb7b00ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50986/0 (socket says 172.21.15.42:50986) 2024-08-17T02:27:54.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7afe00640 1 -- 172.21.15.42:0/2985639922 learned_addr learned my addr 172.21.15.42:0/2985639922 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:54.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7a7e00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 0x7fb7b015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.281+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300366001 0 0) 0x7fb7b00ae060 con 0x7fb7b00b10e0 2024-08-17T02:27:54.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7940034e0 con 0x7fb7b00b10e0 2024-08-17T02:27:54.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911443621 0 0) 0x7fb7b00c9ce0 con 0x7fb7b014d780 2024-08-17T02:27:54.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b00ae060 con 0x7fb7b014d780 2024-08-17T02:27:54.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4008335653 0 0) 0x7fb7940034e0 con 0x7fb7b00b10e0 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 msgr2=0x7fb7b015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 0x7fb7b015af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 >> v1:172.21.15.62:6789/0 conn(0x7fb7b014d780 legacy=0x7fb7b00b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b01574b0 con 0x7fb7b00b10e0 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fb7a80017f0 con 0x7fb7b00b10e0 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 >> v1:172.21.15.42:6789/0 conn(0x7fb7b00b10e0 legacy=0x7fb7b00ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb794003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 0x7fb794004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb794004d10 0x7fb794005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79400bb60 con 0x7fb794003c00 2024-08-17T02:27:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79400bcd0 con 0x7fb794004d10 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79400be90 con 0x7fb7b014db50 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7af400640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb794003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7afe00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb794004d10 0x7fb794005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.282+0000 7fb7a7e00640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 0x7fb794004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.283+0000 7fb7af400640 1 -- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 msgr2=0x7fb794004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.283+0000 7fb7af400640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b014db50 0x7fb794004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.283+0000 7fb7af400640 1 -- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb794004d10 msgr2=0x7fb794005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.283+0000 7fb7af400640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb794004d10 0x7fb794005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.283+0000 7fb7af400640 1 -- 172.21.15.42:0/2985639922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940034e0 con 0x7fb794003c00 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7af400640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb794003ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007fd0 tx=0x7fb7a0007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c830960abaf7311 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a002aa40 con 0x7fb794003c00 2024-08-17T02:27:54.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a002aba0 con 0x7fb794003c00 2024-08-17T02:27:54.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7aea00640 1 -- 172.21.15.42:0/2985639922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00323f0 con 0x7fb794003c00 2024-08-17T02:27:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7b5200640 1 -- 172.21.15.42:0/2985639922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 msgr2=0x7fb794003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7b5200640 1 --2- 172.21.15.42:0/2985639922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb794003ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0007fd0 tx=0x7fb7a0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.284+0000 7fb7afe00640 1 -- 172.21.15.42:0/2985639922 reap_dead start 2024-08-17T02:27:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.285+0000 7fb7b5200640 1 -- 172.21.15.42:0/2985639922 shutdown_connections 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.285+0000 7fb7b5200640 1 -- 172.21.15.42:0/2985639922 >> 172.21.15.42:0/2985639922 conn(0x7fb7b00cb770 msgr2=0x7fb7b00cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.285+0000 7fb7b5200640 1 -- 172.21.15.42:0/2985639922 shutdown_connections 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.285+0000 7fb7b5200640 1 -- 172.21.15.42:0/2985639922 wait complete. 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.286+0000 7fb7b5200640 1 Processor -- start 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.286+0000 7fb7b5200640 1 -- start start 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7b5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb7b00a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7b5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7b015a200 0x7fb7b00af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7b5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b00af910 0x7fb7b0148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7b5200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015a970 con 0x7fb794003c00 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7b5200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015ac50 con 0x7fb7b015a200 2024-08-17T02:27:54.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7b5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b015af30 con 0x7fb7b00af910 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7af400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb7b00a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7af400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb7b00a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37472/0 (socket says 172.21.15.42:37472) 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7af400640 1 -- 172.21.15.42:0/3623947259 learned_addr learned my addr 172.21.15.42:0/3623947259 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7a7e00640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7b015a200 0x7fb7b00af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.287+0000 7fb7afe00640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b00af910 0x7fb7b0148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7af400640 1 -- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b00af910 msgr2=0x7fb7b0148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7af400640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b00af910 0x7fb7b0148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7af400640 1 -- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7b015a200 msgr2=0x7fb7b00af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7af400640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7b015a200 0x7fb7b00af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7af400640 1 -- 172.21.15.42:0/3623947259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b015b210 con 0x7fb794003c00 2024-08-17T02:27:54.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7af400640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb7b00a9de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb7a002a600 tx=0x7fb7a0003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0007250 con 0x7fb794003c00 2024-08-17T02:27:54.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a00073b0 con 0x7fb794003c00 2024-08-17T02:27:54.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b015b4f0 con 0x7fb794003c00 2024-08-17T02:27:54.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0006790 con 0x7fb794003c00 2024-08-17T02:27:54.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.288+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b015ba10 con 0x7fb794003c00 2024-08-17T02:27:54.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.290+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b0070720 con 0x7fb794003c00 2024-08-17T02:27:54.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.290+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb7a0006b80 con 0x7fb794003c00 2024-08-17T02:27:54.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.291+0000 7fb7a6a00640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb78c065180 0x7fb78c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.291+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7a00a1cb0 con 0x7fb794003c00 2024-08-17T02:27:54.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.291+0000 7fb7a7e00640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb78c065180 0x7fb78c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.292+0000 7fb7a7e00640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb78c065180 0x7fb78c067630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7b01569b0 tx=0x7fb7980090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.295+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb7a006fea0 con 0x7fb794003c00 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.476+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7b0070720 con 0x7fb794003c00 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.476+0000 7fb7a6a00640 1 -- 172.21.15.42:0/3623947259 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7a00410a0 con 0x7fb794003c00 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb78c065180 msgr2=0x7fb78c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb78c065180 0x7fb78c067630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb7b01569b0 tx=0x7fb7980090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 msgr2=0x7fb7b00a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb7b00a9de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb7a002a600 tx=0x7fb7a0003000 comp rx=0 tx=0).stop 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 shutdown_connections 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb78c065180 0x7fb78c067630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7b00af910 0x7fb7b0148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7b015a200 0x7fb7b00af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 --2- 172.21.15.42:0/3623947259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb794003c00 0x7fb7b00a9de0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 >> 172.21.15.42:0/3623947259 conn(0x7fb7b00cb770 msgr2=0x7fb7b0069730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 shutdown_connections 2024-08-17T02:27:54.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.478+0000 7fb7b5200640 1 -- 172.21.15.42:0/3623947259 wait complete. 2024-08-17T02:27:54.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.646+0000 7ff23a600640 1 Processor -- start 2024-08-17T02:27:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.646+0000 7ff23a600640 1 -- start start 2024-08-17T02:27:54.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff23a600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff2340afca0 0x7ff2340b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff23a600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff23a600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff2341589a0 0x7ff234158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff23a600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2340b0980 con 0x7ff2341589a0 2024-08-17T02:27:54.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff23a600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23415a4e0 con 0x7ff2340afca0 2024-08-17T02:27:54.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff23a600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c92b0 con 0x7ff2340acf10 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff233e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff2341589a0 0x7ff234158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff233e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff2341589a0 0x7ff234158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37482/0 (socket says 172.21.15.42:37482) 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff233e00640 1 -- 172.21.15.42:0/757157980 learned_addr learned my addr 172.21.15.42:0/757157980 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff22be00640 1 --2- 172.21.15.42:0/757157980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.647+0000 7ff233400640 1 --2- 172.21.15.42:0/757157980 >> v2:172.21.15.62:3300/0 conn(0x7ff2340afca0 0x7ff2340b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.648+0000 7ff233e00640 1 -- 172.21.15.42:0/757157980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 msgr2=0x7ff234159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.648+0000 7ff233e00640 1 --2- 172.21.15.42:0/757157980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.648+0000 7ff233e00640 1 -- 172.21.15.42:0/757157980 >> v2:172.21.15.62:3300/0 conn(0x7ff2340afca0 msgr2=0x7ff2340b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.648+0000 7ff233e00640 1 --2- 172.21.15.42:0/757157980 >> v2:172.21.15.62:3300/0 conn(0x7ff2340afca0 0x7ff2340b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.648+0000 7ff233e00640 1 -- 172.21.15.42:0/757157980 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234159360 con 0x7ff2341589a0 2024-08-17T02:27:54.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.648+0000 7ff233400640 1 --2- 172.21.15.42:0/757157980 >> v2:172.21.15.62:3300/0 conn(0x7ff2340afca0 0x7ff2340b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.649+0000 7ff233e00640 1 --2- 172.21.15.42:0/757157980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2341589a0 0x7ff234158e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009f50 tx=0x7ff22c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd300d11869d14e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.649+0000 7ff232a00640 1 -- 172.21.15.42:0/757157980 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c007400 con 0x7ff2341589a0 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.649+0000 7ff232a00640 1 -- 172.21.15.42:0/757157980 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c007560 con 0x7ff2341589a0 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.649+0000 7ff232a00640 1 -- 172.21.15.42:0/757157980 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c007900 con 0x7ff2341589a0 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.649+0000 7ff23a600640 1 -- 172.21.15.42:0/757157980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2341589a0 msgr2=0x7ff234158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.649+0000 7ff23a600640 1 --2- 172.21.15.42:0/757157980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2341589a0 0x7ff234158e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009f50 tx=0x7ff22c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 -- 172.21.15.42:0/757157980 shutdown_connections 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 --2- 172.21.15.42:0/757157980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2341589a0 0x7ff234158e20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 --2- 172.21.15.42:0/757157980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 --2- 172.21.15.42:0/757157980 >> v2:172.21.15.62:3300/0 conn(0x7ff2340afca0 0x7ff2340b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 -- 172.21.15.42:0/757157980 >> 172.21.15.42:0/757157980 conn(0x7ff234066e60 msgr2=0x7ff234067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 -- 172.21.15.42:0/757157980 shutdown_connections 2024-08-17T02:27:54.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.650+0000 7ff23a600640 1 -- 172.21.15.42:0/757157980 wait complete. 2024-08-17T02:27:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.651+0000 7ff23a600640 1 Processor -- start 2024-08-17T02:27:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.651+0000 7ff23a600640 1 -- start start 2024-08-17T02:27:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff23a600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234169480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff23a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 0x7ff23414dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff23a600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2341589a0 0x7ff234147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff23a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff234146d60 con 0x7ff2340afca0 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff23a600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2341699c0 con 0x7ff2341589a0 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff23a600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff234146150 con 0x7ff2340acf10 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff22be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 0x7ff23414dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff22be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 0x7ff23414dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37488/0 (socket says 172.21.15.42:37488) 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.652+0000 7ff22be00640 1 -- 172.21.15.42:0/1352898862 learned_addr learned my addr 172.21.15.42:0/1352898862 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff233400640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff233e00640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2341589a0 0x7ff234147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22be00640 1 -- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 msgr2=0x7ff234169480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22be00640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234169480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22be00640 1 -- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2341589a0 msgr2=0x7ff234147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22be00640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2341589a0 0x7ff234147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22be00640 1 -- 172.21.15.42:0/1352898862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c009ae0 con 0x7ff2340afca0 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff233e00640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2341589a0 0x7ff234147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22be00640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 0x7ff23414dfa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e900 tx=0x7ff21c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00c8e0 con 0x7ff2340afca0 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00ca40 con 0x7ff2340afca0 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff234146430 con 0x7ff2340afca0 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.653+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00cde0 con 0x7ff2340afca0 2024-08-17T02:27:54.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.654+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2341469f0 con 0x7ff2340afca0 2024-08-17T02:27:54.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.655+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff234146ed0 con 0x7ff2340afca0 2024-08-17T02:27:54.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.655+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff21c013680 con 0x7ff2340afca0 2024-08-17T02:27:54.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.657+0000 7ff22aa00640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff210065150 0x7ff210067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.657+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff21c0825f0 con 0x7ff2340afca0 2024-08-17T02:27:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.657+0000 7ff233400640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff210065150 0x7ff210067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.657+0000 7ff233400640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff210065150 0x7ff210067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2340c9080 tx=0x7ff224008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.661+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff21c050780 con 0x7ff2340afca0 2024-08-17T02:27:54.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.843+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff234063fb0 con 0x7ff2340afca0 2024-08-17T02:27:54.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.844+0000 7ff22aa00640 1 -- 172.21.15.42:0/1352898862 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff21c053da0 con 0x7ff2340afca0 2024-08-17T02:27:54.844 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff210065150 msgr2=0x7ff210067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff210065150 0x7ff210067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff2340c9080 tx=0x7ff224008040 comp rx=0 tx=0).stop 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 msgr2=0x7ff23414dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 0x7ff23414dfa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e900 tx=0x7ff21c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 shutdown_connections 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff210065150 0x7ff210067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff2341589a0 0x7ff234147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2340afca0 0x7ff23414dfa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 --2- 172.21.15.42:0/1352898862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff2340acf10 0x7ff234169480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 >> 172.21.15.42:0/1352898862 conn(0x7ff234066e60 msgr2=0x7ff23406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 shutdown_connections 2024-08-17T02:27:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:54.846+0000 7ff23a600640 1 -- 172.21.15.42:0/1352898862 wait complete. 2024-08-17T02:27:54.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:55.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.014+0000 7fe5ae200640 1 Processor -- start 2024-08-17T02:27:55.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.014+0000 7fe5ae200640 1 -- start start 2024-08-17T02:27:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5ae200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe5a81590b0 0x7fe5a80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5ae200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5ae200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a815a4e0 con 0x7fe5a80afca0 2024-08-17T02:27:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5ae200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a80b0980 con 0x7fe5a81590b0 2024-08-17T02:27:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5ae200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80c92b0 con 0x7fe5a80acf10 2024-08-17T02:27:55.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5a7400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe5a80afca0 0x7fe5a81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50994/0 (socket says 172.21.15.42:50994) 2024-08-17T02:27:55.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5a7400640 1 -- 172.21.15.42:0/2859737982 learned_addr learned my addr 172.21.15.42:0/2859737982 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:55.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe59fe00640 1 --2- 172.21.15.42:0/2859737982 >> v2:172.21.15.62:3300/0 conn(0x7fe5a81590b0 0x7fe5a80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.015+0000 7fe5a7e00640 1 --2- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.016+0000 7fe59fe00640 1 -- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 msgr2=0x7fe5a8159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.016+0000 7fe59fe00640 1 --2- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.016+0000 7fe59fe00640 1 -- 172.21.15.42:0/2859737982 >> v1:172.21.15.42:6789/0 conn(0x7fe5a80afca0 legacy=0x7fe5a81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.016+0000 7fe59fe00640 1 -- 172.21.15.42:0/2859737982 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80ad480 con 0x7fe5a81590b0 2024-08-17T02:27:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.016+0000 7fe5a6a00640 1 -- 172.21.15.42:0/2859737982 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651171519 0 0) 0x7fe598001110 con 0x7fe5a80afca0 2024-08-17T02:27:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.017+0000 7fe59fe00640 1 --2- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a80b0070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe590009850 tx=0x7fe5900090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d52b8b32e6d4c0e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.017+0000 7fe5a6a00640 1 -- 172.21.15.42:0/2859737982 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59002ad90 con 0x7fe5a81590b0 2024-08-17T02:27:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.017+0000 7fe5a6a00640 1 -- 172.21.15.42:0/2859737982 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590032440 con 0x7fe5a81590b0 2024-08-17T02:27:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.017+0000 7fe5a6a00640 1 -- 172.21.15.42:0/2859737982 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900327e0 con 0x7fe5a81590b0 2024-08-17T02:27:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 -- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 msgr2=0x7fe5a80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a80b0070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe590009850 tx=0x7fe5900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 -- 172.21.15.42:0/2859737982 shutdown_connections 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2859737982 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a80b0070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 -- 172.21.15.42:0/2859737982 >> 172.21.15.42:0/2859737982 conn(0x7fe5a8066e60 msgr2=0x7fe5a8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 -- 172.21.15.42:0/2859737982 shutdown_connections 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.018+0000 7fe5ae200640 1 -- 172.21.15.42:0/2859737982 wait complete. 2024-08-17T02:27:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.019+0000 7fe5ae200640 1 Processor -- start 2024-08-17T02:27:55.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 -- start start 2024-08-17T02:27:55.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 0x7fe5a814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a815fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a815a7f0 con 0x7fe5a80afca0 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a815b370 con 0x7fe5a81590b0 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.020+0000 7fe5ae200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a815aa40 con 0x7fe5a80acf10 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 0x7fe5a814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 0x7fe5a814a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37498/0 (socket says 172.21.15.42:37498) 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 -- 172.21.15.42:0/2036682724 learned_addr learned my addr 172.21.15.42:0/2036682724 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe5a7e00640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a815fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe5a7400640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 -- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 msgr2=0x7fe5a8148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 -- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 msgr2=0x7fe5a815fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a815fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.021+0000 7fe59fe00640 1 -- 172.21.15.42:0/2036682724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590009390 con 0x7fe5a80afca0 2024-08-17T02:27:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.022+0000 7fe59fe00640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 0x7fe5a814a460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe590009850 tx=0x7fe590032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.022+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590000d10 con 0x7fe5a80afca0 2024-08-17T02:27:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.022+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590031a60 con 0x7fe5a80afca0 2024-08-17T02:27:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.022+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590031e80 con 0x7fe5a80afca0 2024-08-17T02:27:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.022+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a815ad20 con 0x7fe5a80afca0 2024-08-17T02:27:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.022+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a814a9a0 con 0x7fe5a80afca0 2024-08-17T02:27:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.023+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a815b500 con 0x7fe5a80afca0 2024-08-17T02:27:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.024+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe59003d630 con 0x7fe5a80afca0 2024-08-17T02:27:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.024+0000 7fe59ea00640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe584065150 0x7fe584067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.025+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5900a3260 con 0x7fe5a80afca0 2024-08-17T02:27:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.025+0000 7fe5a7400640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe584065150 0x7fe584067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.025+0000 7fe5a7400640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe584065150 0x7fe584067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe598006e90 tx=0x7fe598007b00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.028+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe590071330 con 0x7fe5a80afca0 2024-08-17T02:27:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.214+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5a8063fb0 con 0x7fe5a80afca0 2024-08-17T02:27:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.214+0000 7fe59ea00640 1 -- 172.21.15.42:0/2036682724 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe590074950 con 0x7fe5a80afca0 2024-08-17T02:27:55.215 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe584065150 msgr2=0x7fe584067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe584065150 0x7fe584067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe598006e90 tx=0x7fe598007b00 comp rx=0 tx=0).stop 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 msgr2=0x7fe5a814a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 0x7fe5a814a460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe590009850 tx=0x7fe590032000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 shutdown_connections 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe584065150 0x7fe584067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe5a81590b0 0x7fe5a815fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5a80afca0 0x7fe5a814a460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 --2- 172.21.15.42:0/2036682724 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe5a80acf10 0x7fe5a8148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 >> 172.21.15.42:0/2036682724 conn(0x7fe5a8066e60 msgr2=0x7fe5a80cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 shutdown_connections 2024-08-17T02:27:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.217+0000 7fe5ae200640 1 -- 172.21.15.42:0/2036682724 wait complete. 2024-08-17T02:27:55.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:55.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.383+0000 7f3e78800640 1 Processor -- start 2024-08-17T02:27:55.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.383+0000 7f3e78800640 1 -- start start 2024-08-17T02:27:55.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e78800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3e700ad960 0x7f3e7015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e78800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700add30 0x7f3e70156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e78800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7015b5e0 con 0x7f3e700ca050 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e78800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700cb160 con 0x7f3e700ad960 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e78800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700b0d10 con 0x7f3e700add30 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e75e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3e700ad960 0x7f3e7015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e75e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3e700ad960 0x7f3e7015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37504/0 (socket says 172.21.15.42:37504) 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e75e00640 1 -- 172.21.15.42:0/2735076852 learned_addr learned my addr 172.21.15.42:0/2735076852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.384+0000 7f3e75400640 1 --1- 172.21.15.42:0/2735076852 >> v1:172.21.15.42:6789/0 conn(0x7f3e700ca050 0x7f3e70156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51002/0 (socket says 172.21.15.42:51002) 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e75e00640 1 -- 172.21.15.42:0/2735076852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700add30 msgr2=0x7f3e70156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e76800640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700add30 0x7f3e70156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e75e00640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700add30 0x7f3e70156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e75e00640 1 -- 172.21.15.42:0/2735076852 >> v1:172.21.15.42:6789/0 conn(0x7f3e700ca050 legacy=0x7f3e70156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e74a00640 1 -- 172.21.15.42:0/2735076852 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482523707 0 0) 0x7f3e60001110 con 0x7f3e700ca050 2024-08-17T02:27:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e75e00640 1 -- 172.21.15.42:0/2735076852 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700ca550 con 0x7f3e700ad960 2024-08-17T02:27:55.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.385+0000 7f3e76800640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700add30 0x7f3e70156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.386+0000 7f3e75e00640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700ad960 0x7f3e7015b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009910 tx=0x7f3e640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2b3c20d847b8eb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.386+0000 7f3e74a00640 1 -- 172.21.15.42:0/2735076852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64032440 con 0x7f3e700ad960 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.386+0000 7f3e74a00640 1 -- 172.21.15.42:0/2735076852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e640325a0 con 0x7f3e700ad960 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.386+0000 7f3e74a00640 1 -- 172.21.15.42:0/2735076852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64032940 con 0x7f3e700ad960 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.386+0000 7f3e78800640 1 -- 172.21.15.42:0/2735076852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700ad960 msgr2=0x7f3e7015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.386+0000 7f3e78800640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700ad960 0x7f3e7015b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009910 tx=0x7f3e640091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.387+0000 7f3e78800640 1 -- 172.21.15.42:0/2735076852 shutdown_connections 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.387+0000 7f3e78800640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700add30 0x7f3e70156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.387+0000 7f3e78800640 1 --2- 172.21.15.42:0/2735076852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700ad960 0x7f3e7015b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.387+0000 7f3e78800640 1 -- 172.21.15.42:0/2735076852 >> 172.21.15.42:0/2735076852 conn(0x7f3e70066e60 msgr2=0x7f3e70067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.387+0000 7f3e78800640 1 -- 172.21.15.42:0/2735076852 shutdown_connections 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.387+0000 7f3e78800640 1 -- 172.21.15.42:0/2735076852 wait complete. 2024-08-17T02:27:55.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.388+0000 7f3e78800640 1 Processor -- start 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.388+0000 7f3e78800640 1 -- start start 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e78800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e700ad960 0x7f3e701510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e78800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 0x7f3e70157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e78800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700ca050 0x7f3e7015c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e78800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7015a8c0 con 0x7f3e700add30 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e78800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70159cb0 con 0x7f3e700ad960 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e78800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70159f90 con 0x7f3e700ca050 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e75400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 0x7f3e70157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e75400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 0x7f3e70157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37506/0 (socket says 172.21.15.42:37506) 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e75400640 1 -- 172.21.15.42:0/3065713282 learned_addr learned my addr 172.21.15.42:0/3065713282 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e75e00640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e700ad960 0x7f3e701510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.389+0000 7f3e76800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700ca050 0x7f3e7015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e75400640 1 -- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700ca050 msgr2=0x7f3e7015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e75400640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700ca050 0x7f3e7015c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e75400640 1 -- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e700ad960 msgr2=0x7f3e701510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e75400640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e700ad960 0x7f3e701510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e75400640 1 -- 172.21.15.42:0/3065713282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009450 con 0x7f3e700add30 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e75400640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 0x7f3e70157170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c5b0 tx=0x7f3e60007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60007300 con 0x7f3e700add30 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e600074a0 con 0x7f3e700add30 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e600049f0 con 0x7f3e700add30 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7015a270 con 0x7f3e700add30 2024-08-17T02:27:55.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.390+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e70159890 con 0x7f3e700add30 2024-08-17T02:27:55.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.391+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e70063fb0 con 0x7f3e700add30 2024-08-17T02:27:55.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.392+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3e6001c3b0 con 0x7f3e700add30 2024-08-17T02:27:55.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.393+0000 7f3e69600640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3e54065150 0x7f3e54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.393+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e60081670 con 0x7f3e700add30 2024-08-17T02:27:55.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.393+0000 7f3e75e00640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3e54065150 0x7f3e54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.394+0000 7f3e75e00640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3e54065150 0x7f3e54067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034000 tx=0x7f3e64032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.397+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3e6004ce40 con 0x7f3e700add30 2024-08-17T02:27:55.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.579+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e7015b5e0 con 0x7f3e700add30 2024-08-17T02:27:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.579+0000 7f3e69600640 1 -- 172.21.15.42:0/3065713282 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f3e7015b5e0 con 0x7f3e700add30 2024-08-17T02:27:55.580 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:55.580 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:55.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3e54065150 msgr2=0x7f3e54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3e54065150 0x7f3e54067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034000 tx=0x7f3e64032000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 msgr2=0x7f3e70157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 0x7f3e70157170 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c5b0 tx=0x7f3e60007f20 comp rx=0 tx=0).stop 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 shutdown_connections 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3e54065150 0x7f3e54067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3e700ca050 0x7f3e7015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e700add30 0x7f3e70157170 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 --2- 172.21.15.42:0/3065713282 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e700ad960 0x7f3e701510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 >> 172.21.15.42:0/3065713282 conn(0x7f3e70066e60 msgr2=0x7f3e70151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 shutdown_connections 2024-08-17T02:27:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.582+0000 7f3e78800640 1 -- 172.21.15.42:0/3065713282 wait complete. 2024-08-17T02:27:55.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:55.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.750+0000 7f9b68600640 1 Processor -- start 2024-08-17T02:27:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.750+0000 7f9b68600640 1 -- start start 2024-08-17T02:27:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.751+0000 7f9b68600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 0x7f9b600add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.751+0000 7f9b68600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9b600b0ac0 0x7f9b600ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.751+0000 7f9b68600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b600ad8a0 con 0x7f9b600ae860 2024-08-17T02:27:55.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.751+0000 7f9b68600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6006edf0 con 0x7f9b600b0ac0 2024-08-17T02:27:55.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.751+0000 7f9b68600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600acc90 con 0x7f9b60158e60 2024-08-17T02:27:55.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 0x7f9b600add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 0x7f9b600add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54540/0 (socket says 172.21.15.42:54540) 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 -- 172.21.15.42:0/1206191220 learned_addr learned my addr 172.21.15.42:0/1206191220 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b66600640 1 --2- 172.21.15.42:0/1206191220 >> v2:172.21.15.62:3300/0 conn(0x7f9b600b0ac0 0x7f9b600ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 -- 172.21.15.42:0/1206191220 >> v2:172.21.15.62:3300/0 conn(0x7f9b600b0ac0 msgr2=0x7f9b600ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 --2- 172.21.15.42:0/1206191220 >> v2:172.21.15.62:3300/0 conn(0x7f9b600b0ac0 0x7f9b600ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 -- 172.21.15.42:0/1206191220 >> v1:172.21.15.62:6789/0 conn(0x7f9b600ae860 legacy=0x7f9b600b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.752+0000 7f9b65c00640 1 -- 172.21.15.42:0/1206191220 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600acf70 con 0x7f9b60158e60 2024-08-17T02:27:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b65c00640 1 --2- 172.21.15.42:0/1206191220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 0x7f9b600add30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009910 tx=0x7f9b540091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55f7b2529a03e84 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b5fe00640 1 -- 172.21.15.42:0/1206191220 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5402adb0 con 0x7f9b60158e60 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b5fe00640 1 -- 172.21.15.42:0/1206191220 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54032440 con 0x7f9b60158e60 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b5fe00640 1 -- 172.21.15.42:0/1206191220 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54032820 con 0x7f9b60158e60 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b68600640 1 -- 172.21.15.42:0/1206191220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 msgr2=0x7f9b600add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b68600640 1 --2- 172.21.15.42:0/1206191220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 0x7f9b600add30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009910 tx=0x7f9b540091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b68600640 1 -- 172.21.15.42:0/1206191220 shutdown_connections 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b68600640 1 --2- 172.21.15.42:0/1206191220 >> v2:172.21.15.62:3300/0 conn(0x7f9b600b0ac0 0x7f9b600ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b68600640 1 --2- 172.21.15.42:0/1206191220 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b60158e60 0x7f9b600add30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.754+0000 7f9b68600640 1 -- 172.21.15.42:0/1206191220 >> 172.21.15.42:0/1206191220 conn(0x7f9b600cc390 msgr2=0x7f9b60066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.755+0000 7f9b68600640 1 -- 172.21.15.42:0/1206191220 shutdown_connections 2024-08-17T02:27:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.755+0000 7f9b68600640 1 -- 172.21.15.42:0/1206191220 wait complete. 2024-08-17T02:27:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.756+0000 7f9b68600640 1 Processor -- start 2024-08-17T02:27:55.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.756+0000 7f9b68600640 1 -- start start 2024-08-17T02:27:55.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b68600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b600ae860 0x7f9b600c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b68600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b600b0ac0 0x7f9b600a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b68600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 0x7f9b600c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b68600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600a9c90 con 0x7f9b60158e60 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b68600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600aa120 con 0x7f9b600b0ac0 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b68600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600a9080 con 0x7f9b600ae860 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b66600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 0x7f9b600c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b65c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b600ae860 0x7f9b600c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b65c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b600ae860 0x7f9b600c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54556/0 (socket says 172.21.15.42:54556) 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b65c00640 1 -- 172.21.15.42:0/1848697773 learned_addr learned my addr 172.21.15.42:0/1848697773 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b66600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 0x7f9b600c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37510/0 (socket says 172.21.15.42:37510) 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.757+0000 7f9b65200640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b600b0ac0 0x7f9b600a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b66600640 1 -- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b600ae860 msgr2=0x7f9b600c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b66600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b600ae860 0x7f9b600c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b66600640 1 -- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b600b0ac0 msgr2=0x7f9b600a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b66600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b600b0ac0 0x7f9b600a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b66600640 1 -- 172.21.15.42:0/1848697773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009450 con 0x7f9b60158e60 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b66600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 0x7f9b600c3750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b600b00d0 tx=0x7f9b5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800cd40 con 0x7f9b60158e60 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5800f040 con 0x7f9b60158e60 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5800cea0 con 0x7f9b60158e60 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b600a9360 con 0x7f9b60158e60 2024-08-17T02:27:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.758+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b600a9920 con 0x7f9b60158e60 2024-08-17T02:27:55.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.760+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b600a9e40 con 0x7f9b60158e60 2024-08-17T02:27:55.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.760+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b580148e0 con 0x7f9b60158e60 2024-08-17T02:27:55.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.761+0000 7f9b5cc00640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b40065180 0x7f9b40067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.761+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b580830e0 con 0x7f9b60158e60 2024-08-17T02:27:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.761+0000 7f9b65c00640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b40065180 0x7f9b40067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.762+0000 7f9b65c00640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b40065180 0x7f9b40067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009910 tx=0x7f9b54032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.765+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9b600a9e40 con 0x7f9b60158e60 2024-08-17T02:27:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.950+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b60063fb0 con 0x7f9b60158e60 2024-08-17T02:27:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.950+0000 7f9b5cc00640 1 -- 172.21.15.42:0/1848697773 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b58054c40 con 0x7f9b60158e60 2024-08-17T02:27:55.951 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b40065180 msgr2=0x7f9b40067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b40065180 0x7f9b40067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009910 tx=0x7f9b54032000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 msgr2=0x7f9b600c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 0x7f9b600c3750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b600b00d0 tx=0x7f9b5800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 shutdown_connections 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b40065180 0x7f9b40067630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b60158e60 0x7f9b600c3750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b600b0ac0 0x7f9b600a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 --2- 172.21.15.42:0/1848697773 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b600ae860 0x7f9b600c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 >> 172.21.15.42:0/1848697773 conn(0x7f9b600cc390 msgr2=0x7f9b600aa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 shutdown_connections 2024-08-17T02:27:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:55.953+0000 7f9b68600640 1 -- 172.21.15.42:0/1848697773 wait complete. 2024-08-17T02:27:55.969 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:56.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.122+0000 7fa753200640 1 Processor -- start 2024-08-17T02:27:56.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.123+0000 7fa753200640 1 -- start start 2024-08-17T02:27:56.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa753200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa7540ac550 0x7fa7540af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa753200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540686f0 con 0x7fa7540af7e0 2024-08-17T02:27:56.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa753200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540b0270 con 0x7fa754158a40 2024-08-17T02:27:56.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa753200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540aff90 con 0x7fa7540ac550 2024-08-17T02:27:56.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa751400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa7540ac550 0x7fa7540af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa752800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa7540af7e0 0x7fa754068b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51008/0 (socket says 172.21.15.42:51008) 2024-08-17T02:27:56.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.124+0000 7fa752800640 1 -- 172.21.15.42:0/3708309663 learned_addr learned my addr 172.21.15.42:0/3708309663 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:56.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.125+0000 7fa751400640 1 -- 172.21.15.42:0/3708309663 >> v1:172.21.15.62:6789/0 conn(0x7fa754158a40 legacy=0x7fa7540abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.125+0000 7fa751400640 1 -- 172.21.15.42:0/3708309663 >> v1:172.21.15.42:6789/0 conn(0x7fa7540af7e0 legacy=0x7fa754068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.125+0000 7fa751400640 1 -- 172.21.15.42:0/3708309663 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540680a0 con 0x7fa7540ac550 2024-08-17T02:27:56.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.125+0000 7fa750a00640 1 -- 172.21.15.42:0/3708309663 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701668827 0 0) 0x7fa7540686f0 con 0x7fa7540af7e0 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.126+0000 7fa751400640 1 --2- 172.21.15.42:0/3708309663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540ac550 0x7fa7540af2a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa740009850 tx=0x7fa7400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108c9feebe7ddab7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.126+0000 7fa750a00640 1 -- 172.21.15.42:0/3708309663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74002ad00 con 0x7fa7540ac550 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.126+0000 7fa750a00640 1 -- 172.21.15.42:0/3708309663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74002ae60 con 0x7fa7540ac550 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.126+0000 7fa750a00640 1 -- 172.21.15.42:0/3708309663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740032670 con 0x7fa7540ac550 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 -- 172.21.15.42:0/3708309663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540ac550 msgr2=0x7fa7540af2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 --2- 172.21.15.42:0/3708309663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540ac550 0x7fa7540af2a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa740009850 tx=0x7fa7400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 -- 172.21.15.42:0/3708309663 shutdown_connections 2024-08-17T02:27:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 --2- 172.21.15.42:0/3708309663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540ac550 0x7fa7540af2a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 -- 172.21.15.42:0/3708309663 >> 172.21.15.42:0/3708309663 conn(0x7fa7540ce400 msgr2=0x7fa754095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 -- 172.21.15.42:0/3708309663 shutdown_connections 2024-08-17T02:27:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.127+0000 7fa753200640 1 -- 172.21.15.42:0/3708309663 wait complete. 2024-08-17T02:27:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.128+0000 7fa753200640 1 Processor -- start 2024-08-17T02:27:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.128+0000 7fa753200640 1 -- start start 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa753200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540ac550 0x7fa75414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa753200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 0x7fa7540b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa753200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa754158a40 0x7fa754069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa753200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754169ec0 con 0x7fa7540af7e0 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa753200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754169280 con 0x7fa754158a40 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa753200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75414e360 con 0x7fa7540ac550 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.129+0000 7fa751400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 0x7fa7540b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 0x7fa7540b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37540/0 (socket says 172.21.15.42:37540) 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 -- 172.21.15.42:0/3576048859 learned_addr learned my addr 172.21.15.42:0/3576048859 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751e00640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540ac550 0x7fa75414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa752800640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa754158a40 0x7fa754069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 -- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540ac550 msgr2=0x7fa75414de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540ac550 0x7fa75414de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 -- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa754158a40 msgr2=0x7fa754069260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa754158a40 0x7fa754069260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 -- 172.21.15.42:0/3576048859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009390 con 0x7fa7540af7e0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa752800640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa754158a40 0x7fa754069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa751400640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 0x7fa7540b24a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa740009360 tx=0x7fa740032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740031800 con 0x7fa7540af7e0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.130+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740031960 con 0x7fa7540af7e0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.131+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740031d20 con 0x7fa7540af7e0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.131+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa754169520 con 0x7fa7540af7e0 2024-08-17T02:27:56.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.131+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa754169ae0 con 0x7fa7540af7e0 2024-08-17T02:27:56.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.132+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75416a000 con 0x7fa7540af7e0 2024-08-17T02:27:56.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.133+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa740043030 con 0x7fa7540af7e0 2024-08-17T02:27:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.134+0000 7fa749600640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa734065150 0x7fa734067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.134+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa740041070 con 0x7fa7540af7e0 2024-08-17T02:27:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.134+0000 7fa751e00640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa734065150 0x7fa734067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.134+0000 7fa751e00640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa734065150 0x7fa734067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa744003720 tx=0x7fa744009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.138+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa75416a000 con 0x7fa7540af7e0 2024-08-17T02:27:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.319+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa75416a000 con 0x7fa7540af7e0 2024-08-17T02:27:56.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.319+0000 7fa749600640 1 -- 172.21.15.42:0/3576048859 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa74004b020 con 0x7fa7540af7e0 2024-08-17T02:27:56.319 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa734065150 msgr2=0x7fa734067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa734065150 0x7fa734067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa744003720 tx=0x7fa744009040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 msgr2=0x7fa7540b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 0x7fa7540b24a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa740009360 tx=0x7fa740032000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 shutdown_connections 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa734065150 0x7fa734067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa754158a40 0x7fa754069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7540af7e0 0x7fa7540b24a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 --2- 172.21.15.42:0/3576048859 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa7540ac550 0x7fa75414de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 >> 172.21.15.42:0/3576048859 conn(0x7fa7540ce400 msgr2=0x7fa754155230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 shutdown_connections 2024-08-17T02:27:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.321+0000 7fa753200640 1 -- 172.21.15.42:0/3576048859 wait complete. 2024-08-17T02:27:56.336 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:56.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.493+0000 7f4151400640 1 Processor -- start 2024-08-17T02:27:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.493+0000 7f4151400640 1 -- start start 2024-08-17T02:27:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.494+0000 7f4151400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f414c158a40 0x7f414c0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.494+0000 7f4151400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.494+0000 7f4151400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0686f0 con 0x7f414c0ac380 2024-08-17T02:27:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.494+0000 7f4151400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c0ac800 con 0x7f414c158a40 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.494+0000 7f4151400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0b0270 con 0x7f414c0af9b0 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f414be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f414c158a40 0x7f414c0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f4143e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f414c0ac380 0x7f414c0af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51016/0 (socket says 172.21.15.42:51016) 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f4143e00640 1 -- 172.21.15.42:0/2379574308 learned_addr learned my addr 172.21.15.42:0/2379574308 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f4150a00640 1 --2- 172.21.15.42:0/2379574308 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f414be00640 1 -- 172.21.15.42:0/2379574308 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 msgr2=0x7f414c068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f414be00640 1 --2- 172.21.15.42:0/2379574308 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f414be00640 1 -- 172.21.15.42:0/2379574308 >> v1:172.21.15.42:6789/0 conn(0x7f414c0ac380 legacy=0x7f414c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.495+0000 7f414be00640 1 -- 172.21.15.42:0/2379574308 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0aff90 con 0x7f414c158a40 2024-08-17T02:27:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.496+0000 7f414be00640 1 --2- 172.21.15.42:0/2379574308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c158a40 0x7f414c0abe40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f413c009850 tx=0x7f413c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82ba49f91df054d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.496+0000 7f414b400640 1 -- 172.21.15.42:0/2379574308 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c02ad00 con 0x7f414c158a40 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.496+0000 7f414b400640 1 -- 172.21.15.42:0/2379574308 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c02ae60 con 0x7f414c158a40 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.496+0000 7f414b400640 1 -- 172.21.15.42:0/2379574308 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c032670 con 0x7f414c158a40 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 -- 172.21.15.42:0/2379574308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c158a40 msgr2=0x7f414c0abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 --2- 172.21.15.42:0/2379574308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c158a40 0x7f414c0abe40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f413c009850 tx=0x7f413c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 -- 172.21.15.42:0/2379574308 shutdown_connections 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 --2- 172.21.15.42:0/2379574308 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 --2- 172.21.15.42:0/2379574308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c158a40 0x7f414c0abe40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 -- 172.21.15.42:0/2379574308 >> 172.21.15.42:0/2379574308 conn(0x7f414c0ce400 msgr2=0x7f414c095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 -- 172.21.15.42:0/2379574308 shutdown_connections 2024-08-17T02:27:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.497+0000 7f4151400640 1 -- 172.21.15.42:0/2379574308 wait complete. 2024-08-17T02:27:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.498+0000 7f4151400640 1 Processor -- start 2024-08-17T02:27:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 -- start start 2024-08-17T02:27:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 0x7f414c14e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c158a40 0x7f414c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c15d270 con 0x7f414c0ac380 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0b1220 con 0x7f414c158a40 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.499+0000 7f4151400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0b08f0 con 0x7f414c0af9b0 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 0x7f414c14e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 0x7f414c14e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37550/0 (socket says 172.21.15.42:37550) 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 -- 172.21.15.42:0/2517178522 learned_addr learned my addr 172.21.15.42:0/2517178522 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f4150a00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c158a40 0x7f414c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f4143e00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 -- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 msgr2=0x7f414c1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 -- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c158a40 msgr2=0x7f414c157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c158a40 0x7f414c157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 -- 172.21.15.42:0/2517178522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c009390 con 0x7f414c0ac380 2024-08-17T02:27:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f4150a00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c158a40 0x7f414c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.500+0000 7f414be00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 0x7f414c14e850 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f413c009360 tx=0x7f413c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.501+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031780 con 0x7f414c0ac380 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.501+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0318e0 con 0x7f414c0ac380 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.501+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c0b0bd0 con 0x7f414c0ac380 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.501+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c031c80 con 0x7f414c0ac380 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.501+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c14ed90 con 0x7f414c0ac380 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.502+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c14efb0 con 0x7f414c0ac380 2024-08-17T02:27:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.503+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f413c039040 con 0x7f414c0ac380 2024-08-17T02:27:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.503+0000 7f4143400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4128065150 0x7f4128067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.504+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f413c041030 con 0x7f414c0ac380 2024-08-17T02:27:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.504+0000 7f4143e00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4128065150 0x7f4128067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.504+0000 7f4143e00640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4128065150 0x7f4128067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4134007fd0 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.508+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f413c070b80 con 0x7f414c0ac380 2024-08-17T02:27:56.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.688+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f414c070720 con 0x7f414c0ac380 2024-08-17T02:27:56.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.689+0000 7f4143400640 1 -- 172.21.15.42:0/2517178522 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f413c0370a0 con 0x7f414c0ac380 2024-08-17T02:27:56.689 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.690+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4128065150 msgr2=0x7f4128067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.690+0000 7f4151400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4128065150 0x7f4128067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4134007fd0 tx=0x7f4134009040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.690+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 msgr2=0x7f414c14e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.690+0000 7f4151400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 0x7f414c14e850 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f413c009360 tx=0x7f413c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 shutdown_connections 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f4128065150 0x7f4128067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f414c158a40 0x7f414c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f414c0af9b0 0x7f414c1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 --2- 172.21.15.42:0/2517178522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f414c0ac380 0x7f414c14e850 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 >> 172.21.15.42:0/2517178522 conn(0x7f414c0ce400 msgr2=0x7f414c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 shutdown_connections 2024-08-17T02:27:56.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.691+0000 7f4151400640 1 -- 172.21.15.42:0/2517178522 wait complete. 2024-08-17T02:27:56.778 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:27:56.779 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:27:56.779 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.930+0000 7f5f7e400640 1 Processor -- start 2024-08-17T02:27:56.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.930+0000 7f5f7e400640 1 -- start start 2024-08-17T02:27:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.931+0000 7f5f7e400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f780b03c0 0x7f5f780b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.931+0000 7f5f7e400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f7806d7d0 0x7f5f7806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.931+0000 7f5f7e400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f780aff30 con 0x7f5f7815cdc0 2024-08-17T02:27:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.931+0000 7f5f7e400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7806e150 con 0x7f5f7806d7d0 2024-08-17T02:27:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.931+0000 7f5f7e400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780af320 con 0x7f5f780b03c0 2024-08-17T02:27:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f6ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f780b03c0 0x7f5f780b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f7806d7d0 0x7f5f7806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f7806d7d0 0x7f5f7806dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:36062/0 (socket says 172.21.15.42:36062) 2024-08-17T02:27:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 -- 172.21.15.42:0/1220334345 learned_addr learned my addr 172.21.15.42:0/1220334345 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f6ea00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f780b03c0 0x7f5f780b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54602/0 (socket says 172.21.15.42:54602) 2024-08-17T02:27:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 -- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f780b03c0 msgr2=0x7f5f780b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 --2- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f780b03c0 0x7f5f780b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 -- 172.21.15.42:0/1220334345 >> v1:172.21.15.62:6789/0 conn(0x7f5f7815cdc0 legacy=0x7f5f780ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.932+0000 7f5f77e00640 1 -- 172.21.15.42:0/1220334345 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780af600 con 0x7f5f7806d7d0 2024-08-17T02:27:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f77e00640 1 --2- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7806d7d0 0x7f5f7806dc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009f20 tx=0x7f5f70009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a44b7a822032e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f76a00640 1 -- 172.21.15.42:0/1220334345 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70031400 con 0x7f5f7806d7d0 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f76a00640 1 -- 172.21.15.42:0/1220334345 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7002d050 con 0x7f5f7806d7d0 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f76a00640 1 -- 172.21.15.42:0/1220334345 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700317d0 con 0x7f5f7806d7d0 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f7e400640 1 -- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7806d7d0 msgr2=0x7f5f7806dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f7e400640 1 --2- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7806d7d0 0x7f5f7806dc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009f20 tx=0x7f5f70009840 comp rx=0 tx=0).stop 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f7e400640 1 -- 172.21.15.42:0/1220334345 shutdown_connections 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f7e400640 1 --2- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7806d7d0 0x7f5f7806dc10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f7e400640 1 --2- 172.21.15.42:0/1220334345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f780b03c0 0x7f5f780b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.934+0000 7f5f7e400640 1 -- 172.21.15.42:0/1220334345 >> 172.21.15.42:0/1220334345 conn(0x7f5f78066e60 msgr2=0x7f5f78067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.935+0000 7f5f7e400640 1 -- 172.21.15.42:0/1220334345 shutdown_connections 2024-08-17T02:27:56.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.935+0000 7f5f7e400640 1 -- 172.21.15.42:0/1220334345 wait complete. 2024-08-17T02:27:56.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.936+0000 7f5f7e400640 1 Processor -- start 2024-08-17T02:27:56.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.936+0000 7f5f7e400640 1 -- start start 2024-08-17T02:27:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f7e400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f7806d7d0 0x7f5f78154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f7e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 0x7f5f7816d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f7e400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7815cdc0 0x7f5f78156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f7e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78157730 con 0x7f5f780b03c0 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f7e400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c0ca0 con 0x7f5f7815cdc0 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f7e400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c0f80 con 0x7f5f7806d7d0 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f6ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 0x7f5f7816d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f6ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 0x7f5f7816d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37556/0 (socket says 172.21.15.42:37556) 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f6ea00640 1 -- 172.21.15.42:0/3018842121 learned_addr learned my addr 172.21.15.42:0/3018842121 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.937+0000 7f5f77400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f7806d7d0 0x7f5f78154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f77e00640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7815cdc0 0x7f5f78156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6ea00640 1 -- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f7806d7d0 msgr2=0x7f5f78154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6ea00640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f7806d7d0 0x7f5f78154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6ea00640 1 -- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7815cdc0 msgr2=0x7f5f78156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6ea00640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7815cdc0 0x7f5f78156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6ea00640 1 -- 172.21.15.42:0/3018842121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009ae0 con 0x7f5f780b03c0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f77400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f7806d7d0 0x7f5f78154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f77e00640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7815cdc0 0x7f5f78156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6ea00640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 0x7f5f7816d310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000ea20 tx=0x7f5f600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000ca10 con 0x7f5f780b03c0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000cb70 con 0x7f5f780b03c0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f60013470 con 0x7f5f780b03c0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f780c1260 con 0x7f5f780b03c0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.938+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f78155030 con 0x7f5f780b03c0 2024-08-17T02:27:56.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.940+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f781578e0 con 0x7f5f780b03c0 2024-08-17T02:27:56.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.940+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5f60013860 con 0x7f5f780b03c0 2024-08-17T02:27:56.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.941+0000 7f5f6f400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5f54065150 0x7f5f54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.941+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f60082940 con 0x7f5f780b03c0 2024-08-17T02:27:56.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.941+0000 7f5f77400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5f54065150 0x7f5f54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.942+0000 7f5f77400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5f54065150 0x7f5f54067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f68001780 tx=0x7f5f68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:56.945+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5f781578e0 con 0x7f5f780b03c0 2024-08-17T02:27:57.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.130+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f78063fb0 con 0x7f5f780b03c0 2024-08-17T02:27:57.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.131+0000 7f5f6f400640 1 -- 172.21.15.42:0/3018842121 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f5f60050a20 con 0x7f5f780b03c0 2024-08-17T02:27:57.132 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:27:57.132 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5f54065150 msgr2=0x7f5f54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5f54065150 0x7f5f54067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5f68001780 tx=0x7f5f68009040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 msgr2=0x7f5f7816d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 0x7f5f7816d310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000ea20 tx=0x7f5f600090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 shutdown_connections 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5f54065150 0x7f5f54067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f7815cdc0 0x7f5f78156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f780b03c0 0x7f5f7816d310 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 --2- 172.21.15.42:0/3018842121 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f7806d7d0 0x7f5f78154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 >> 172.21.15.42:0/3018842121 conn(0x7f5f78066e60 msgr2=0x7f5f780a6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 shutdown_connections 2024-08-17T02:27:57.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.133+0000 7f5f7e400640 1 -- 172.21.15.42:0/3018842121 wait complete. 2024-08-17T02:27:57.149 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:57.149 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.303+0000 7f2174a00640 1 Processor -- start 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.303+0000 7f2174a00640 1 -- start start 2024-08-17T02:27:57.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f2174a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f21700afef0 0x7f21700b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f2174a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700c8be0 con 0x7f21700ae860 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f2174a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700af440 con 0x7f2170155300 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f2174a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700ad880 con 0x7f21700afef0 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f216de00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f21700afef0 0x7f21700b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f216de00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f21700afef0 0x7f21700b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37564/0 (socket says 172.21.15.42:37564) 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f216de00640 1 -- 172.21.15.42:0/3280222391 learned_addr learned my addr 172.21.15.42:0/3280222391 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.304+0000 7f2167e00640 1 --1- 172.21.15.42:0/3280222391 >> v1:172.21.15.42:6789/0 conn(0x7f21700ae860 0x7f2170154bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51022/0 (socket says 172.21.15.42:51022) 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.305+0000 7f216de00640 1 -- 172.21.15.42:0/3280222391 >> v1:172.21.15.62:6789/0 conn(0x7f2170155300 legacy=0x7f21700c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.305+0000 7f216de00640 1 -- 172.21.15.42:0/3280222391 >> v1:172.21.15.42:6789/0 conn(0x7f21700ae860 legacy=0x7f2170154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.305+0000 7f216de00640 1 -- 172.21.15.42:0/3280222391 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700af720 con 0x7f21700afef0 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.306+0000 7f216de00640 1 --2- 172.21.15.42:0/3280222391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700b02c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2160009910 tx=0x7f21600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368ac55747198d0a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.306+0000 7f216d400640 1 -- 172.21.15.42:0/3280222391 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160031510 con 0x7f21700afef0 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.306+0000 7f216d400640 1 -- 172.21.15.42:0/3280222391 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216002f050 con 0x7f21700afef0 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.306+0000 7f216d400640 1 -- 172.21.15.42:0/3280222391 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600318e0 con 0x7f21700afef0 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 -- 172.21.15.42:0/3280222391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 msgr2=0x7f21700b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 --2- 172.21.15.42:0/3280222391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700b02c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2160009910 tx=0x7f21600091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 -- 172.21.15.42:0/3280222391 shutdown_connections 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 --2- 172.21.15.42:0/3280222391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700b02c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 -- 172.21.15.42:0/3280222391 >> 172.21.15.42:0/3280222391 conn(0x7f21700cc390 msgr2=0x7f2170066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 -- 172.21.15.42:0/3280222391 shutdown_connections 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.307+0000 7f2174a00640 1 -- 172.21.15.42:0/3280222391 wait complete. 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.308+0000 7f2174a00640 1 Processor -- start 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 -- start start 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21700ae860 0x7f21700c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2170155300 0x7f21700c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217015ddb0 con 0x7f21700afef0 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217015e090 con 0x7f21700ae860 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.309+0000 7f2174a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217015e370 con 0x7f2170155300 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37570/0 (socket says 172.21.15.42:37570) 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 -- 172.21.15.42:0/3388889578 learned_addr learned my addr 172.21.15.42:0/3388889578 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f216de00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21700ae860 0x7f21700c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f216e800640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2170155300 0x7f21700c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 -- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2170155300 msgr2=0x7f21700c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2170155300 0x7f21700c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 -- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21700ae860 msgr2=0x7f21700c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21700ae860 0x7f21700c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 -- 172.21.15.42:0/3388889578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160009450 con 0x7f21700afef0 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.310+0000 7f2167e00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700c29a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f215800c590 tx=0x7f2158007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.311+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158007300 con 0x7f21700afef0 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.311+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580074a0 con 0x7f21700afef0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.311+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217015e650 con 0x7f21700afef0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.311+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580047a0 con 0x7f21700afef0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.311+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700c18d0 con 0x7f21700afef0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.312+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2170063fb0 con 0x7f21700afef0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.313+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2158004bd0 con 0x7f21700afef0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.313+0000 7f2165600640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f214c065150 0x7f214c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.313+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21580818b0 con 0x7f21700afef0 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.314+0000 7f216de00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f214c065150 0x7f214c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.314+0000 7f216de00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f214c065150 0x7f214c067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2160036000 tx=0x7f2160037000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.317+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f215804fa00 con 0x7f21700afef0 2024-08-17T02:27:57.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.503+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21700ad150 con 0x7f21700afef0 2024-08-17T02:27:57.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.503+0000 7f2165600640 1 -- 172.21.15.42:0/3388889578 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21580180a0 con 0x7f21700afef0 2024-08-17T02:27:57.504 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f214c065150 msgr2=0x7f214c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f214c065150 0x7f214c067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2160036000 tx=0x7f2160037000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 msgr2=0x7f21700c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700c29a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f215800c590 tx=0x7f2158007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 shutdown_connections 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f214c065150 0x7f214c067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2170155300 0x7f21700c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21700afef0 0x7f21700c29a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 --2- 172.21.15.42:0/3388889578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21700ae860 0x7f21700c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 >> 172.21.15.42:0/3388889578 conn(0x7f21700cc390 msgr2=0x7f217006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 shutdown_connections 2024-08-17T02:27:57.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.505+0000 7f2174a00640 1 -- 172.21.15.42:0/3388889578 wait complete. 2024-08-17T02:27:57.520 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.675+0000 7efdc0c00640 1 Processor -- start 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.675+0000 7efdc0c00640 1 -- start start 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdc0c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efdbc0afca0 0x7efdbc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdc0c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc0acf10 0x7efdbc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdc0c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efdbc1589a0 0x7efdbc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdc0c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0b0980 con 0x7efdbc0afca0 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdc0c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc15a4e0 con 0x7efdbc1589a0 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdc0c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0c92b0 con 0x7efdbc0acf10 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.676+0000 7efdb9e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efdbc0afca0 0x7efdbc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdba800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efdbc1589a0 0x7efdbc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efdbc0afca0 0x7efdbc0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37572/0 (socket says 172.21.15.42:37572) 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 -- 172.21.15.42:0/1546988868 learned_addr learned my addr 172.21.15.42:0/1546988868 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9400640 1 --2- 172.21.15.42:0/1546988868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc0acf10 0x7efdbc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 -- 172.21.15.42:0/1546988868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc0acf10 msgr2=0x7efdbc159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 --2- 172.21.15.42:0/1546988868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc0acf10 0x7efdbc159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 -- 172.21.15.42:0/1546988868 >> v2:172.21.15.62:3300/0 conn(0x7efdbc1589a0 msgr2=0x7efdbc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 --2- 172.21.15.42:0/1546988868 >> v2:172.21.15.62:3300/0 conn(0x7efdbc1589a0 0x7efdbc158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.677+0000 7efdb9e00640 1 -- 172.21.15.42:0/1546988868 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc159360 con 0x7efdbc0afca0 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.678+0000 7efdb9e00640 1 --2- 172.21.15.42:0/1546988868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc0b0070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efdac009910 tx=0x7efdac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22b4f398a130d40 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.678+0000 7efdb8a00640 1 -- 172.21.15.42:0/1546988868 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac02adb0 con 0x7efdbc0afca0 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.678+0000 7efdb8a00640 1 -- 172.21.15.42:0/1546988868 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac032440 con 0x7efdbc0afca0 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.678+0000 7efdb8a00640 1 -- 172.21.15.42:0/1546988868 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac032820 con 0x7efdbc0afca0 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 -- 172.21.15.42:0/1546988868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 msgr2=0x7efdbc0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1546988868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc0b0070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efdac009910 tx=0x7efdac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 -- 172.21.15.42:0/1546988868 shutdown_connections 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1546988868 >> v2:172.21.15.62:3300/0 conn(0x7efdbc1589a0 0x7efdbc158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1546988868 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc0acf10 0x7efdbc159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1546988868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc0b0070 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 -- 172.21.15.42:0/1546988868 >> 172.21.15.42:0/1546988868 conn(0x7efdbc066e60 msgr2=0x7efdbc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 -- 172.21.15.42:0/1546988868 shutdown_connections 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.679+0000 7efdc0c00640 1 -- 172.21.15.42:0/1546988868 wait complete. 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.680+0000 7efdc0c00640 1 Processor -- start 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.680+0000 7efdc0c00640 1 -- start start 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdc0c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdbc0acf10 0x7efdbc14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdc0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdc0c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc1589a0 0x7efdbc164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdc0c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc14f630 con 0x7efdbc0afca0 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdc0c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc14ec60 con 0x7efdbc0acf10 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdc0c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc1478b0 con 0x7efdbc1589a0 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37580/0 (socket says 172.21.15.42:37580) 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.681+0000 7efdb9400640 1 -- 172.21.15.42:0/1081553934 learned_addr learned my addr 172.21.15.42:0/1081553934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9e00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdbc0acf10 0x7efdbc14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdba800640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc1589a0 0x7efdbc164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9400640 1 -- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc1589a0 msgr2=0x7efdbc164e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9400640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc1589a0 0x7efdbc164e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9400640 1 -- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdbc0acf10 msgr2=0x7efdbc14f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9400640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdbc0acf10 0x7efdbc14f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9400640 1 -- 172.21.15.42:0/1081553934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009450 con 0x7efdbc0afca0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb9400640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc146d30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efda800e900 tx=0x7efda80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800c8e0 con 0x7efdbc0afca0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800ca40 con 0x7efdbc0afca0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800cde0 con 0x7efdbc0afca0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.682+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc165920 con 0x7efdbc0afca0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.683+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc14e8f0 con 0x7efdbc0afca0 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.684+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc14edf0 con 0x7efdbc0afca0 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.685+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efda8013680 con 0x7efdbc0afca0 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.686+0000 7efdb1600640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efd9c065150 0x7efd9c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.686+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efda8082610 con 0x7efdbc0afca0 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.687+0000 7efdb9e00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efd9c065150 0x7efd9c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.687+0000 7efdb9e00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efd9c065150 0x7efd9c067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.690+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efda80507a0 con 0x7efdbc0afca0 2024-08-17T02:27:57.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.874+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdbc063fb0 con 0x7efdbc0afca0 2024-08-17T02:27:57.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.874+0000 7efdb1600640 1 -- 172.21.15.42:0/1081553934 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7efda8053dc0 con 0x7efdbc0afca0 2024-08-17T02:27:57.875 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:27:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efd9c065150 msgr2=0x7efd9c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efd9c065150 0x7efd9c067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac032000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 msgr2=0x7efdbc146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc146d30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efda800e900 tx=0x7efda80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 shutdown_connections 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efd9c065150 0x7efd9c067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efdbc1589a0 0x7efdbc164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdbc0afca0 0x7efdbc146d30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 --2- 172.21.15.42:0/1081553934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efdbc0acf10 0x7efdbc14f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 >> 172.21.15.42:0/1081553934 conn(0x7efdbc066e60 msgr2=0x7efdbc152550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 shutdown_connections 2024-08-17T02:27:57.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:57.877+0000 7efdc0c00640 1 -- 172.21.15.42:0/1081553934 wait complete. 2024-08-17T02:27:57.893 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.046+0000 7fb73f600640 1 Processor -- start 2024-08-17T02:27:58.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.046+0000 7fb73f600640 1 -- start start 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.047+0000 7fb73f600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb738155d90 0x7fb7380a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.047+0000 7fb73f600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7380b11c0 0x7fb7380a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.047+0000 7fb73f600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7380ad9f0 con 0x7fb7381559c0 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.047+0000 7fb73f600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7380ae1d0 con 0x7fb738155d90 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.047+0000 7fb73f600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7380adc90 con 0x7fb7380b11c0 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.047+0000 7fb737e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb738155d90 0x7fb7380a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb73d600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7380b11c0 0x7fb7380a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb738155d90 0x7fb7380a96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37582/0 (socket says 172.21.15.42:37582) 2024-08-17T02:27:58.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737e00640 1 -- 172.21.15.42:0/2128927953 learned_addr learned my addr 172.21.15.42:0/2128927953 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737e00640 1 -- 172.21.15.42:0/2128927953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7380b11c0 msgr2=0x7fb7380a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737e00640 1 --2- 172.21.15.42:0/2128927953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7380b11c0 0x7fb7380a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737e00640 1 -- 172.21.15.42:0/2128927953 >> v1:172.21.15.62:6789/0 conn(0x7fb7381559c0 legacy=0x7fb7380acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737e00640 1 -- 172.21.15.42:0/2128927953 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380adf30 con 0x7fb738155d90 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb737400640 1 -- 172.21.15.42:0/2128927953 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799054701 0 0) 0x7fb7380ad9f0 con 0x7fb7381559c0 2024-08-17T02:27:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.048+0000 7fb73d600640 1 --2- 172.21.15.42:0/2128927953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7380b11c0 0x7fb7380a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:58.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.049+0000 7fb737e00640 1 --2- 172.21.15.42:0/2128927953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb7380a96c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb724009910 tx=0x7fb7240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19109d30bf7585 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.049+0000 7fb737400640 1 -- 172.21.15.42:0/2128927953 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72402ae40 con 0x7fb738155d90 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.049+0000 7fb737400640 1 -- 172.21.15.42:0/2128927953 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724032440 con 0x7fb738155d90 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.049+0000 7fb737400640 1 -- 172.21.15.42:0/2128927953 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240327e0 con 0x7fb738155d90 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 -- 172.21.15.42:0/2128927953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 msgr2=0x7fb7380a96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 --2- 172.21.15.42:0/2128927953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb7380a96c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb724009910 tx=0x7fb7240091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 -- 172.21.15.42:0/2128927953 shutdown_connections 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 --2- 172.21.15.42:0/2128927953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7380b11c0 0x7fb7380a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 --2- 172.21.15.42:0/2128927953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb7380a96c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 -- 172.21.15.42:0/2128927953 >> 172.21.15.42:0/2128927953 conn(0x7fb738095a70 msgr2=0x7fb738095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 -- 172.21.15.42:0/2128927953 shutdown_connections 2024-08-17T02:27:58.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.050+0000 7fb73f600640 1 -- 172.21.15.42:0/2128927953 wait complete. 2024-08-17T02:27:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.051+0000 7fb73f600640 1 Processor -- start 2024-08-17T02:27:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 -- start start 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7380b11c0 0x7fb7381567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7381559c0 0x7fb738162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb738169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73816a080 con 0x7fb738155d90 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7380ca770 con 0x7fb7380b11c0 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.052+0000 7fb73f600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb738169ac0 con 0x7fb7381559c0 2024-08-17T02:27:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb738169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb738169030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37598/0 (socket says 172.21.15.42:37598) 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 -- 172.21.15.42:0/2810873184 learned_addr learned my addr 172.21.15.42:0/2810873184 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb737e00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7381559c0 0x7fb738162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73cc00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7380b11c0 0x7fb7381567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 -- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7381559c0 msgr2=0x7fb738162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7381559c0 0x7fb738162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 -- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7380b11c0 msgr2=0x7fb7381567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7380b11c0 0x7fb7381567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 -- 172.21.15.42:0/2810873184 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730009a20 con 0x7fb738155d90 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb737e00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7381559c0 0x7fb738162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73cc00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7380b11c0 0x7fb7381567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.053+0000 7fb73d600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb738169030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb730009fc0 tx=0x7fb73000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.054+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000ce70 con 0x7fb738155d90 2024-08-17T02:27:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.054+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73000f040 con 0x7fb738155d90 2024-08-17T02:27:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.054+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300146d0 con 0x7fb738155d90 2024-08-17T02:27:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.054+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb724009450 con 0x7fb738155d90 2024-08-17T02:27:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.054+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7380cacf0 con 0x7fb738155d90 2024-08-17T02:27:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.055+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb738169ec0 con 0x7fb738155d90 2024-08-17T02:27:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.056+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb730003020 con 0x7fb738155d90 2024-08-17T02:27:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.056+0000 7fb72be00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb718065150 0x7fb718067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.056+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb730082ff0 con 0x7fb738155d90 2024-08-17T02:27:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.057+0000 7fb73cc00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb718065150 0x7fb718067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.057+0000 7fb73cc00640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb718065150 0x7fb718067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0011e0 tx=0x7fb72c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.060+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb730051050 con 0x7fb738155d90 2024-08-17T02:27:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.245+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb738063fb0 con 0x7fb738155d90 2024-08-17T02:27:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.245+0000 7fb72be00640 1 -- 172.21.15.42:0/2810873184 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb730054670 con 0x7fb738155d90 2024-08-17T02:27:58.246 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:27:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb718065150 msgr2=0x7fb718067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb718065150 0x7fb718067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0011e0 tx=0x7fb72c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 msgr2=0x7fb738169030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb738169030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb730009fc0 tx=0x7fb73000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 shutdown_connections 2024-08-17T02:27:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb718065150 0x7fb718067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb738155d90 0x7fb738169030 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7381559c0 0x7fb738162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 --2- 172.21.15.42:0/2810873184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7380b11c0 0x7fb7381567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 >> 172.21.15.42:0/2810873184 conn(0x7fb738095a70 msgr2=0x7fb7380acf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 shutdown_connections 2024-08-17T02:27:58.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.248+0000 7fb73f600640 1 -- 172.21.15.42:0/2810873184 wait complete. 2024-08-17T02:27:58.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:27:58.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.414+0000 7f9b72400640 1 Processor -- start 2024-08-17T02:27:58.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.414+0000 7f9b72400640 1 -- start start 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b72400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b6c158a20 0x7f9b6c0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b72400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b72400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6c0aed90 con 0x7f9b6c0ae860 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b72400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6c0af070 con 0x7f9b6c158a20 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b72400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0af350 con 0x7f9b6c06dee0 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b6b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b6c158a20 0x7f9b6c0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b6b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b6c158a20 0x7f9b6c0a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37612/0 (socket says 172.21.15.42:37612) 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b6b400640 1 -- 172.21.15.42:0/1600459583 learned_addr learned my addr 172.21.15.42:0/1600459583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b6be00640 1 --2- 172.21.15.42:0/1600459583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b6b400640 1 -- 172.21.15.42:0/1600459583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 msgr2=0x7f9b6c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.416+0000 7f9b6b400640 1 --2- 172.21.15.42:0/1600459583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c0afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.417+0000 7f9b6b400640 1 -- 172.21.15.42:0/1600459583 >> v1:172.21.15.62:6789/0 conn(0x7f9b6c0ae860 legacy=0x7f9b6c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.417+0000 7f9b6b400640 1 -- 172.21.15.42:0/1600459583 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0af630 con 0x7f9b6c158a20 2024-08-17T02:27:58.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b6b400640 1 --2- 172.21.15.42:0/1600459583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c0a89c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009910 tx=0x7f9b5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cefbad249fa392 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b6aa00640 1 -- 172.21.15.42:0/1600459583 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c02ae40 con 0x7f9b6c158a20 2024-08-17T02:27:58.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b6aa00640 1 -- 172.21.15.42:0/1600459583 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c032440 con 0x7f9b6c158a20 2024-08-17T02:27:58.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b6aa00640 1 -- 172.21.15.42:0/1600459583 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c032820 con 0x7f9b6c158a20 2024-08-17T02:27:58.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b72400640 1 -- 172.21.15.42:0/1600459583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 msgr2=0x7f9b6c0a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b72400640 1 --2- 172.21.15.42:0/1600459583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c0a89c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009910 tx=0x7f9b5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b72400640 1 -- 172.21.15.42:0/1600459583 shutdown_connections 2024-08-17T02:27:58.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b72400640 1 --2- 172.21.15.42:0/1600459583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b72400640 1 --2- 172.21.15.42:0/1600459583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c0a89c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.418+0000 7f9b72400640 1 -- 172.21.15.42:0/1600459583 >> 172.21.15.42:0/1600459583 conn(0x7f9b6c066e60 msgr2=0x7f9b6c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.419+0000 7f9b72400640 1 -- 172.21.15.42:0/1600459583 shutdown_connections 2024-08-17T02:27:58.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.419+0000 7f9b72400640 1 -- 172.21.15.42:0/1600459583 wait complete. 2024-08-17T02:27:58.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.420+0000 7f9b72400640 1 Processor -- start 2024-08-17T02:27:58.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.420+0000 7f9b72400640 1 -- start start 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b72400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b72400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b6c0ae860 0x7f9b6c169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b72400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b72400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c169fb0 con 0x7f9b6c158a20 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b72400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c157480 con 0x7f9b6c0ae860 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b72400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c156870 con 0x7f9b6c06dee0 2024-08-17T02:27:58.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b6b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37620/0 (socket says 172.21.15.42:37620) 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b6be00640 1 -- 172.21.15.42:0/1253284919 learned_addr learned my addr 172.21.15.42:0/1253284919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.421+0000 7f9b63e00640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b6c0ae860 0x7f9b6c169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6be00640 1 -- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 msgr2=0x7f9b6c151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6be00640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6be00640 1 -- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b6c0ae860 msgr2=0x7f9b6c169a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6be00640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b6c0ae860 0x7f9b6c169a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6be00640 1 -- 172.21.15.42:0/1253284919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c009450 con 0x7f9b6c158a20 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6b400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:58.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b6be00640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c157910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009ef0 tx=0x7f9b6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400cdb0 con 0x7f9b6c158a20 2024-08-17T02:27:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6400f040 con 0x7f9b6c158a20 2024-08-17T02:27:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c156b50 con 0x7f9b6c158a20 2024-08-17T02:27:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640146d0 con 0x7f9b6c158a20 2024-08-17T02:27:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.422+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c157110 con 0x7f9b6c158a20 2024-08-17T02:27:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.424+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6c157630 con 0x7f9b6c158a20 2024-08-17T02:27:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.424+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b64014a80 con 0x7f9b6c158a20 2024-08-17T02:27:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.425+0000 7f9b62a00640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b48065150 0x7f9b48067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.425+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b640831f0 con 0x7f9b6c158a20 2024-08-17T02:27:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.425+0000 7f9b6b400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b48065150 0x7f9b48067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.426+0000 7f9b6b400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b48065150 0x7f9b48067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c034000 tx=0x7f9b5c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.429+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9b6c157630 con 0x7f9b6c158a20 2024-08-17T02:27:58.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:58.679+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f9b6c1575f0 con 0x7f9b6c158a20 2024-08-17T02:27:59.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.569+0000 7f9b62a00640 1 -- 172.21.15.42:0/1253284919 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b64051380 con 0x7f9b6c158a20 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b48065150 msgr2=0x7f9b48067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b48065150 0x7f9b48067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c034000 tx=0x7f9b5c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 msgr2=0x7f9b6c157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c157910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b64009ef0 tx=0x7f9b6400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 shutdown_connections 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9b48065150 0x7f9b48067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b6c158a20 0x7f9b6c157910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9b6c0ae860 0x7f9b6c169a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 --2- 172.21.15.42:0/1253284919 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9b6c06dee0 0x7f9b6c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.572+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 >> 172.21.15.42:0/1253284919 conn(0x7f9b6c066e60 msgr2=0x7f9b6c0acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.573+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 shutdown_connections 2024-08-17T02:27:59.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.573+0000 7f9b72400640 1 -- 172.21.15.42:0/1253284919 wait complete. 2024-08-17T02:27:59.591 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:27:59.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.752+0000 7f802a800640 1 Processor -- start 2024-08-17T02:27:59.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.752+0000 7f802a800640 1 -- start start 2024-08-17T02:27:59.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.753+0000 7f802a800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240ca050 0x7f8024156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f802a800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f80240add30 0x7f802415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f802a800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802415b5e0 con 0x7f80240ad960 2024-08-17T02:27:59.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f802a800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240cb160 con 0x7f80240add30 2024-08-17T02:27:59.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f802a800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80240b0d10 con 0x7f80240ca050 2024-08-17T02:27:59.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f8023400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f80240ad960 0x7f8024156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51034/0 (socket says 172.21.15.42:51034) 2024-08-17T02:27:59.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f8023400640 1 -- 172.21.15.42:0/45809093 learned_addr learned my addr 172.21.15.42:0/45809093 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:27:59.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f8023e00640 1 --2- 172.21.15.42:0/45809093 >> v2:172.21.15.62:3300/0 conn(0x7f80240add30 0x7f802415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f801be00640 1 --2- 172.21.15.42:0/45809093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240ca050 0x7f8024156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f8022a00640 1 -- 172.21.15.42:0/45809093 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343818304 0 0) 0x7f8014001110 con 0x7f80240ad960 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.754+0000 7f8022a00640 1 -- 172.21.15.42:0/45809093 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80080034e0 con 0x7f80240ad960 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.755+0000 7f801be00640 1 -- 172.21.15.42:0/45809093 >> v2:172.21.15.62:3300/0 conn(0x7f80240add30 msgr2=0x7f802415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.755+0000 7f801be00640 1 --2- 172.21.15.42:0/45809093 >> v2:172.21.15.62:3300/0 conn(0x7f80240add30 0x7f802415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.755+0000 7f801be00640 1 -- 172.21.15.42:0/45809093 >> v1:172.21.15.42:6789/0 conn(0x7f80240ad960 legacy=0x7f8024156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.755+0000 7f801be00640 1 -- 172.21.15.42:0/45809093 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240ca550 con 0x7f80240ca050 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.755+0000 7f8023e00640 1 --2- 172.21.15.42:0/45809093 >> v2:172.21.15.62:3300/0 conn(0x7f80240add30 0x7f802415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.756+0000 7f801be00640 1 --2- 172.21.15.42:0/45809093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240ca050 0x7f8024156b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f800c009850 tx=0x7f800c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ad749546d001db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.756+0000 7f8022a00640 1 -- 172.21.15.42:0/45809093 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c02ae10 con 0x7f80240ca050 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.756+0000 7f8022a00640 1 -- 172.21.15.42:0/45809093 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c032440 con 0x7f80240ca050 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.756+0000 7f8022a00640 1 -- 172.21.15.42:0/45809093 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c032820 con 0x7f80240ca050 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 -- 172.21.15.42:0/45809093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240ca050 msgr2=0x7f8024156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 --2- 172.21.15.42:0/45809093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240ca050 0x7f8024156b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f800c009850 tx=0x7f800c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 -- 172.21.15.42:0/45809093 shutdown_connections 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 --2- 172.21.15.42:0/45809093 >> v2:172.21.15.62:3300/0 conn(0x7f80240add30 0x7f802415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 --2- 172.21.15.42:0/45809093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240ca050 0x7f8024156b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 -- 172.21.15.42:0/45809093 >> 172.21.15.42:0/45809093 conn(0x7f8024066e60 msgr2=0x7f8024067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 -- 172.21.15.42:0/45809093 shutdown_connections 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.757+0000 7f802a800640 1 -- 172.21.15.42:0/45809093 wait complete. 2024-08-17T02:27:59.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.758+0000 7f802a800640 1 Processor -- start 2024-08-17T02:27:59.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.758+0000 7f802a800640 1 -- start start 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.759+0000 7f802a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 0x7f8024139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.759+0000 7f802a800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240add30 0x7f802414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.759+0000 7f802a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80240ca050 0x7f802414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.759+0000 7f802a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80241587a0 con 0x7f80240ad960 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.759+0000 7f802a800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802413a1a0 con 0x7f80240ca050 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.759+0000 7f802a800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80241578f0 con 0x7f80240add30 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 0x7f8024139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 0x7f8024139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37628/0 (socket says 172.21.15.42:37628) 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 -- 172.21.15.42:0/3645784349 learned_addr learned my addr 172.21.15.42:0/3645784349 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 -- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240add30 msgr2=0x7f802414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f801be00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240add30 0x7f802414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023e00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80240ca050 0x7f802414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240add30 0x7f802414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 -- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80240ca050 msgr2=0x7f802414efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80240ca050 0x7f802414efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 -- 172.21.15.42:0/3645784349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c009a20 con 0x7f80240ad960 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f801be00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240add30 0x7f802414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023e00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80240ca050 0x7f802414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.760+0000 7f8023400640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 0x7f8024139c60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f801400c7c0 tx=0x7f8014007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.761+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400ce90 con 0x7f80240ad960 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.761+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014001d70 con 0x7f80240ad960 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.761+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014005aa0 con 0x7f80240ad960 2024-08-17T02:27:59.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.761+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c009390 con 0x7f80240ad960 2024-08-17T02:27:59.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.761+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8024157e70 con 0x7f80240ad960 2024-08-17T02:27:59.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.762+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8024063fb0 con 0x7f80240ad960 2024-08-17T02:27:59.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.763+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f80140070f0 con 0x7f80240ad960 2024-08-17T02:27:59.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.764+0000 7f801aa00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8000065150 0x7f8000067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.764+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8014081d80 con 0x7f80240ad960 2024-08-17T02:27:59.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.764+0000 7f801be00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8000065150 0x7f8000067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.765+0000 7f801be00640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8000065150 0x7f8000067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f800c034000 tx=0x7f800c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.768+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f801404fe20 con 0x7f80240ad960 2024-08-17T02:27:59.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.952+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f802415b5e0 con 0x7f80240ad960 2024-08-17T02:27:59.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.957+0000 7f801aa00640 1 -- 172.21.15.42:0/3645784349 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f802415b5e0 con 0x7f80240ad960 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8000065150 msgr2=0x7f8000067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8000065150 0x7f8000067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f800c034000 tx=0x7f800c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 msgr2=0x7f8024139c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 0x7f8024139c60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f801400c7c0 tx=0x7f8014007be0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 shutdown_connections 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8000065150 0x7f8000067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f80240ca050 0x7f802414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f80240add30 0x7f802414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 --2- 172.21.15.42:0/3645784349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80240ad960 0x7f8024139c60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 >> 172.21.15.42:0/3645784349 conn(0x7f8024066e60 msgr2=0x7f80240aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 shutdown_connections 2024-08-17T02:27:59.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:27:59.959+0000 7f802a800640 1 -- 172.21.15.42:0/3645784349 wait complete. 2024-08-17T02:27:59.975 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:27:59.975 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:00.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:00.181 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:28:00.181 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:28:00.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:00.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:28:00.243 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:28:00.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.243 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:28:00.290 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:28:00.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:00.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:28:00.358 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:28:00.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.358 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:28:00.401 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:28:00.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:00.401 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:28:00.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:28:00.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.463 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:28:00.498 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:28:00.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:00.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:28:00.561 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:28:00.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.561 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:28:00.598 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:28:00.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:00.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.752+0000 7f0a33200640 1 Processor -- start 2024-08-17T02:28:00.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.753+0000 7f0a33200640 1 -- start start 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a33200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a34158bf0 0x7f0a340af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a33200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a340ac4b0 0x7f0a34068770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a33200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a340682e0 con 0x7f0a340ae4a0 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a33200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a340afca0 con 0x7f0a340ac4b0 2024-08-17T02:28:00.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a33200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340aff80 con 0x7f0a34158bf0 2024-08-17T02:28:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a2be00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0a340ae4a0 0x7f0a340abda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51036/0 (socket says 172.21.15.42:51036) 2024-08-17T02:28:00.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.754+0000 7f0a2be00640 1 -- 172.21.15.42:0/4220242929 learned_addr learned my addr 172.21.15.42:0/4220242929 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a32800640 1 --2- 172.21.15.42:0/4220242929 >> v2:172.21.15.62:3300/0 conn(0x7f0a340ac4b0 0x7f0a34068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a31e00640 1 --2- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a34158bf0 0x7f0a340af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a31400640 1 -- 172.21.15.42:0/4220242929 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677227616 0 0) 0x7f0a340682e0 con 0x7f0a340ae4a0 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a31400640 1 -- 172.21.15.42:0/4220242929 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a180034e0 con 0x7f0a340ae4a0 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a32800640 1 -- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a34158bf0 msgr2=0x7f0a340af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a32800640 1 --2- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a34158bf0 0x7f0a340af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a32800640 1 -- 172.21.15.42:0/4220242929 >> v1:172.21.15.42:6789/0 conn(0x7f0a340ae4a0 legacy=0x7f0a340abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.755+0000 7f0a32800640 1 -- 172.21.15.42:0/4220242929 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340b0260 con 0x7f0a340ac4b0 2024-08-17T02:28:00.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.756+0000 7f0a32800640 1 --2- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a340ac4b0 0x7f0a34068770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009e60 tx=0x7f0a2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=444912d121c1b00e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.756+0000 7f0a31400640 1 -- 172.21.15.42:0/4220242929 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c007550 con 0x7f0a340ac4b0 2024-08-17T02:28:00.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.756+0000 7f0a31400640 1 -- 172.21.15.42:0/4220242929 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c02d050 con 0x7f0a340ac4b0 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.756+0000 7f0a31400640 1 -- 172.21.15.42:0/4220242929 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c007900 con 0x7f0a340ac4b0 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 -- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a340ac4b0 msgr2=0x7f0a34068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 --2- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a340ac4b0 0x7f0a34068770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009e60 tx=0x7f0a2c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 -- 172.21.15.42:0/4220242929 shutdown_connections 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 --2- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a340ac4b0 0x7f0a34068770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 --2- 172.21.15.42:0/4220242929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a34158bf0 0x7f0a340af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 -- 172.21.15.42:0/4220242929 >> 172.21.15.42:0/4220242929 conn(0x7f0a340ce420 msgr2=0x7f0a34095d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 -- 172.21.15.42:0/4220242929 shutdown_connections 2024-08-17T02:28:00.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.757+0000 7f0a33200640 1 -- 172.21.15.42:0/4220242929 wait complete. 2024-08-17T02:28:00.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.758+0000 7f0a33200640 1 Processor -- start 2024-08-17T02:28:00.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.759+0000 7f0a33200640 1 -- start start 2024-08-17T02:28:00.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.759+0000 7f0a33200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 0x7f0a34155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.759+0000 7f0a33200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a340ae4a0 0x7f0a34159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.759+0000 7f0a33200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34158bf0 0x7f0a3415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a33200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a34169de0 con 0x7f0a340ac4b0 2024-08-17T02:28:00.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a33200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a341691d0 con 0x7f0a34158bf0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a33200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a341694b0 con 0x7f0a340ae4a0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 0x7f0a34155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 0x7f0a34155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37636/0 (socket says 172.21.15.42:37636) 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 -- 172.21.15.42:0/2283877131 learned_addr learned my addr 172.21.15.42:0/2283877131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a32800640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34158bf0 0x7f0a3415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a2be00640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a340ae4a0 0x7f0a34159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 -- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a340ae4a0 msgr2=0x7f0a34159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a340ae4a0 0x7f0a34159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 -- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34158bf0 msgr2=0x7f0a3415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34158bf0 0x7f0a3415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 -- 172.21.15.42:0/2283877131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c009a20 con 0x7f0a340ac4b0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.760+0000 7f0a31e00640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 0x7f0a34155ec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400e900 tx=0x7f0a240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.761+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400c8e0 con 0x7f0a340ac4b0 2024-08-17T02:28:00.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.761+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2400ca40 con 0x7f0a340ac4b0 2024-08-17T02:28:00.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.761+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400cde0 con 0x7f0a340ac4b0 2024-08-17T02:28:00.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.761+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a34169790 con 0x7f0a340ac4b0 2024-08-17T02:28:00.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.761+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a34156400 con 0x7f0a340ac4b0 2024-08-17T02:28:00.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.762+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a34070720 con 0x7f0a340ac4b0 2024-08-17T02:28:00.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.763+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a24013680 con 0x7f0a340ac4b0 2024-08-17T02:28:00.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.763+0000 7f0a29600640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0a10065150 0x7f0a10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.764+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a24082650 con 0x7f0a340ac4b0 2024-08-17T02:28:00.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.764+0000 7f0a2be00640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0a10065150 0x7f0a10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.764+0000 7f0a2be00640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0a10065150 0x7f0a10067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a3415d0d0 tx=0x7f0a1c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.768+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a24050730 con 0x7f0a340ac4b0 2024-08-17T02:28:00.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.985+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a3406c390 con 0x7f0a340ac4b0 2024-08-17T02:28:00.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.986+0000 7f0a29600640 1 -- 172.21.15.42:0/2283877131 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f0a24053d50 con 0x7f0a340ac4b0 2024-08-17T02:28:00.986 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:00.986 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:00.987 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:28:00.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0a10065150 msgr2=0x7f0a10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0a10065150 0x7f0a10067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0a3415d0d0 tx=0x7f0a1c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 msgr2=0x7f0a34155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 0x7f0a34155ec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400e900 tx=0x7f0a240090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 shutdown_connections 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0a10065150 0x7f0a10067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a34158bf0 0x7f0a3415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a340ae4a0 0x7f0a34159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 --2- 172.21.15.42:0/2283877131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a340ac4b0 0x7f0a34155ec0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 >> 172.21.15.42:0/2283877131 conn(0x7f0a340ce420 msgr2=0x7f0a340ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 shutdown_connections 2024-08-17T02:28:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:00.988+0000 7f0a33200640 1 -- 172.21.15.42:0/2283877131 wait complete. 2024-08-17T02:28:01.005 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:01.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.156+0000 7f88f3200640 1 Processor -- start 2024-08-17T02:28:01.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.156+0000 7f88f3200640 1 -- start start 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.157+0000 7f88f3200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88ec0ad960 0x7f88ec15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.157+0000 7f88f3200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88ec0add30 0x7f88ec156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.157+0000 7f88f3200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec15b5e0 con 0x7f88ec0ca050 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.157+0000 7f88f3200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0cb160 con 0x7f88ec0ad960 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.157+0000 7f88f3200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0b0d10 con 0x7f88ec0add30 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.157+0000 7f88ebe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88ec0ad960 0x7f88ec15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88ebe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88ec0ad960 0x7f88ec15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57336/0 (socket says 172.21.15.42:57336) 2024-08-17T02:28:01.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88ebe00640 1 -- 172.21.15.42:0/940270412 learned_addr learned my addr 172.21.15.42:0/940270412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88f1200640 1 --2- 172.21.15.42:0/940270412 >> v2:172.21.15.62:3300/0 conn(0x7f88ec0add30 0x7f88ec156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88ebe00640 1 -- 172.21.15.42:0/940270412 >> v2:172.21.15.62:3300/0 conn(0x7f88ec0add30 msgr2=0x7f88ec156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88ebe00640 1 --2- 172.21.15.42:0/940270412 >> v2:172.21.15.62:3300/0 conn(0x7f88ec0add30 0x7f88ec156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88ebe00640 1 -- 172.21.15.42:0/940270412 >> v1:172.21.15.62:6789/0 conn(0x7f88ec0ca050 legacy=0x7f88ec156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88ebe00640 1 -- 172.21.15.42:0/940270412 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0ca550 con 0x7f88ec0ad960 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.158+0000 7f88f1200640 1 --2- 172.21.15.42:0/940270412 >> v2:172.21.15.62:3300/0 conn(0x7f88ec0add30 0x7f88ec156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:01.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.159+0000 7f88ebe00640 1 --2- 172.21.15.42:0/940270412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ad960 0x7f88ec15b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0cb0d0 tx=0x7f88dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c8926c46ea39f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.159+0000 7f88eaa00640 1 -- 172.21.15.42:0/940270412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc032440 con 0x7f88ec0ad960 2024-08-17T02:28:01.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.159+0000 7f88eaa00640 1 -- 172.21.15.42:0/940270412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0325a0 con 0x7f88ec0ad960 2024-08-17T02:28:01.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.159+0000 7f88eaa00640 1 -- 172.21.15.42:0/940270412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc032980 con 0x7f88ec0ad960 2024-08-17T02:28:01.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 -- 172.21.15.42:0/940270412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ad960 msgr2=0x7f88ec15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 --2- 172.21.15.42:0/940270412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ad960 0x7f88ec15b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0cb0d0 tx=0x7f88dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 -- 172.21.15.42:0/940270412 shutdown_connections 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 --2- 172.21.15.42:0/940270412 >> v2:172.21.15.62:3300/0 conn(0x7f88ec0add30 0x7f88ec156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 --2- 172.21.15.42:0/940270412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ad960 0x7f88ec15b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 -- 172.21.15.42:0/940270412 >> 172.21.15.42:0/940270412 conn(0x7f88ec066e60 msgr2=0x7f88ec067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 -- 172.21.15.42:0/940270412 shutdown_connections 2024-08-17T02:28:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.160+0000 7f88f3200640 1 -- 172.21.15.42:0/940270412 wait complete. 2024-08-17T02:28:01.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.161+0000 7f88f3200640 1 Processor -- start 2024-08-17T02:28:01.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 -- start start 2024-08-17T02:28:01.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88ec0ad960 0x7f88ec1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0add30 0x7f88ec0a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 0x7f88ec144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec1509f0 con 0x7f88ec0ca050 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0a94d0 con 0x7f88ec0add30 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.162+0000 7f88f3200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0a97b0 con 0x7f88ec0ad960 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 0x7f88ec144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 0x7f88ec144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57340/0 (socket says 172.21.15.42:57340) 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 -- 172.21.15.42:0/2739409183 learned_addr learned my addr 172.21.15.42:0/2739409183 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88ebe00640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88ec0ad960 0x7f88ec1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88eb400640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0add30 0x7f88ec0a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 -- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88ec0ad960 msgr2=0x7f88ec1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88ec0ad960 0x7f88ec1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 -- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0add30 msgr2=0x7f88ec0a8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0add30 0x7f88ec0a8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.163+0000 7f88f1200640 1 -- 172.21.15.42:0/2739409183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc009450 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.164+0000 7f88f1200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 0x7f88ec144260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d180 tx=0x7f88e4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.164+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4015440 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.164+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e400f040 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.164+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4015810 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.164+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec0a9a90 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.164+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec0aa050 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.165+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec0aa270 con 0x7f88ec0ca050 2024-08-17T02:28:01.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.166+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88e401e3b0 con 0x7f88ec0ca050 2024-08-17T02:28:01.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.166+0000 7f88e3400640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f88cc065150 0x7f88cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.167+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88e4082e60 con 0x7f88ec0ca050 2024-08-17T02:28:01.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.167+0000 7f88ebe00640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f88cc065150 0x7f88cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.167+0000 7f88ebe00640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f88cc065150 0x7f88cc067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034000 tx=0x7f88dc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.170+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88e4050f30 con 0x7f88ec0ca050 2024-08-17T02:28:01.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.353+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88ec063fb0 con 0x7f88ec0ca050 2024-08-17T02:28:01.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.354+0000 7f88e3400640 1 -- 172.21.15.42:0/2739409183 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f88e4054550 con 0x7f88ec0ca050 2024-08-17T02:28:01.354 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:01.355 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:01.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f88cc065150 msgr2=0x7f88cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f88cc065150 0x7f88cc067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034000 tx=0x7f88dc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 msgr2=0x7f88ec144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 0x7f88ec144260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d180 tx=0x7f88e4009a50 comp rx=0 tx=0).stop 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 shutdown_connections 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f88cc065150 0x7f88cc067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ec0ca050 0x7f88ec144260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88ec0add30 0x7f88ec0a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 --2- 172.21.15.42:0/2739409183 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f88ec0ad960 0x7f88ec1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 >> 172.21.15.42:0/2739409183 conn(0x7f88ec066e60 msgr2=0x7f88ec0b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 shutdown_connections 2024-08-17T02:28:01.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.356+0000 7f88f3200640 1 -- 172.21.15.42:0/2739409183 wait complete. 2024-08-17T02:28:01.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:22.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:23.849107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:01.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:01.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.526+0000 7fe531600640 1 Processor -- start 2024-08-17T02:28:01.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.526+0000 7fe531600640 1 -- start start 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.527+0000 7fe531600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe52c0ccf90 0x7fe52c0c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.527+0000 7fe531600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c0c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.527+0000 7fe531600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c0c4850 con 0x7fe52c0afe70 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.527+0000 7fe531600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c0b1a40 con 0x7fe52c0ccf90 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.527+0000 7fe531600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c1574c0 con 0x7fe52c0b0240 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.527+0000 7fe52a000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe52c0ccf90 0x7fe52c0c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52a000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe52c0ccf90 0x7fe52c0c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57342/0 (socket says 172.21.15.42:57342) 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52a000640 1 -- 172.21.15.42:0/419297310 learned_addr learned my addr 172.21.15.42:0/419297310 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52b400640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c0c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52a000640 1 -- 172.21.15.42:0/419297310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 msgr2=0x7fe52c0c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52a000640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c0c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52a000640 1 -- 172.21.15.42:0/419297310 >> v1:172.21.15.62:6789/0 conn(0x7fe52c0afe70 legacy=0x7fe52c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52a000640 1 -- 172.21.15.42:0/419297310 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c0b1c30 con 0x7fe52c0ccf90 2024-08-17T02:28:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.528+0000 7fe52b400640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c0c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.529+0000 7fe52a000640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c0c3dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe518009910 tx=0x7fe5180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80c80a19973a3c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.529+0000 7fe529600640 1 -- 172.21.15.42:0/419297310 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518032440 con 0x7fe52c0ccf90 2024-08-17T02:28:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.529+0000 7fe529600640 1 -- 172.21.15.42:0/419297310 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5180325a0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.529+0000 7fe529600640 1 -- 172.21.15.42:0/419297310 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518032980 con 0x7fe52c0ccf90 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 -- 172.21.15.42:0/419297310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 msgr2=0x7fe52c0c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c0c3dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe518009910 tx=0x7fe5180091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 -- 172.21.15.42:0/419297310 shutdown_connections 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c0c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 --2- 172.21.15.42:0/419297310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c0c3dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 -- 172.21.15.42:0/419297310 >> 172.21.15.42:0/419297310 conn(0x7fe52c066e60 msgr2=0x7fe52c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 -- 172.21.15.42:0/419297310 shutdown_connections 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.530+0000 7fe531600640 1 -- 172.21.15.42:0/419297310 wait complete. 2024-08-17T02:28:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.531+0000 7fe531600640 1 Processor -- start 2024-08-17T02:28:01.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.531+0000 7fe531600640 1 -- start start 2024-08-17T02:28:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.532+0000 7fe531600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe52c0afe70 0x7fe52c1697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.532+0000 7fe531600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.532+0000 7fe531600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.532+0000 7fe531600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c15b670 con 0x7fe52c0ccf90 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.532+0000 7fe531600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c15cc90 con 0x7fe52c0afe70 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.532+0000 7fe531600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c15acd0 con 0x7fe52c0b0240 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57358/0 (socket says 172.21.15.42:57358) 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 -- 172.21.15.42:0/1088452270 learned_addr learned my addr 172.21.15.42:0/1088452270 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52a000640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52aa00640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe52c0afe70 0x7fe52c1697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 -- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 msgr2=0x7fe52c15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 -- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe52c0afe70 msgr2=0x7fe52c1697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe52c0afe70 0x7fe52c1697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 -- 172.21.15.42:0/1088452270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009450 con 0x7fe52c0ccf90 2024-08-17T02:28:01.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52aa00640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe52c0afe70 0x7fe52c1697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:01.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.533+0000 7fe52b400640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c15c680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d180 tx=0x7fe524009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.534+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524015440 con 0x7fe52c0ccf90 2024-08-17T02:28:01.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.534+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52400f040 con 0x7fe52c0ccf90 2024-08-17T02:28:01.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.534+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240157f0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.534+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c15afb0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.534+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c15ba90 con 0x7fe52c0ccf90 2024-08-17T02:28:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.535+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c15b7b0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.536+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe52401e3b0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.537+0000 7fe522000640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe50c065150 0x7fe50c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.537+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe524082e10 con 0x7fe52c0ccf90 2024-08-17T02:28:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.537+0000 7fe52aa00640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe50c065150 0x7fe50c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.538+0000 7fe52aa00640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe50c065150 0x7fe50c067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0af690 tx=0x7fe51c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.541+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe52c15b7b0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.727+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe52c15b7b0 con 0x7fe52c0ccf90 2024-08-17T02:28:01.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.727+0000 7fe522000640 1 -- 172.21.15.42:0/1088452270 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe52401a020 con 0x7fe52c0ccf90 2024-08-17T02:28:01.727 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe50c065150 msgr2=0x7fe50c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe50c065150 0x7fe50c067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0af690 tx=0x7fe51c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 msgr2=0x7fe52c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c15c680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d180 tx=0x7fe524009a50 comp rx=0 tx=0).stop 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 shutdown_connections 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe50c065150 0x7fe50c067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe52c0ccf90 0x7fe52c15c680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe52c0b0240 0x7fe52c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 --2- 172.21.15.42:0/1088452270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe52c0afe70 0x7fe52c1697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 >> 172.21.15.42:0/1088452270 conn(0x7fe52c066e60 msgr2=0x7fe52c155840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 shutdown_connections 2024-08-17T02:28:01.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.729+0000 7fe531600640 1 -- 172.21.15.42:0/1088452270 wait complete. 2024-08-17T02:28:01.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:01.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.899+0000 7f0525400640 1 Processor -- start 2024-08-17T02:28:01.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.899+0000 7f0525400640 1 -- start start 2024-08-17T02:28:01.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f0525400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f05200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f0525400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05200acf10 0x7f0520159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f0525400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052015a4e0 con 0x7f05201589a0 2024-08-17T02:28:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f0525400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05200b0980 con 0x7f05200acf10 2024-08-17T02:28:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f0525400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05200c92b0 con 0x7f05200afca0 2024-08-17T02:28:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f0517e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05200acf10 0x7f0520159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f051f200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f05201589a0 0x7f052006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35654/0 (socket says 172.21.15.42:35654) 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.900+0000 7f051f200640 1 -- 172.21.15.42:0/2908522050 learned_addr learned my addr 172.21.15.42:0/2908522050 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.901+0000 7f051e800640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f05200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.901+0000 7f0517e00640 1 -- 172.21.15.42:0/2908522050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 msgr2=0x7f05200b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.901+0000 7f0517e00640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f05200b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.901+0000 7f0517e00640 1 -- 172.21.15.42:0/2908522050 >> v1:172.21.15.42:6789/0 conn(0x7f05201589a0 legacy=0x7f052006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.901+0000 7f0517e00640 1 -- 172.21.15.42:0/2908522050 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200ad480 con 0x7f05200acf10 2024-08-17T02:28:01.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.901+0000 7f051e800640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f05200b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:01.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.902+0000 7f0517e00640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f0520159fa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0508009880 tx=0x7f05080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d9304ab67fc2ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.902+0000 7f051de00640 1 -- 172.21.15.42:0/2908522050 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050802ad70 con 0x7f05200acf10 2024-08-17T02:28:01.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.902+0000 7f051de00640 1 -- 172.21.15.42:0/2908522050 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508032440 con 0x7f05200acf10 2024-08-17T02:28:01.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.902+0000 7f051de00640 1 -- 172.21.15.42:0/2908522050 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508032820 con 0x7f05200acf10 2024-08-17T02:28:01.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 -- 172.21.15.42:0/2908522050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 msgr2=0x7f0520159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f0520159fa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0508009880 tx=0x7f05080090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 -- 172.21.15.42:0/2908522050 shutdown_connections 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f0520159fa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 --2- 172.21.15.42:0/2908522050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f05200b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 -- 172.21.15.42:0/2908522050 >> 172.21.15.42:0/2908522050 conn(0x7f0520066e60 msgr2=0x7f0520067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 -- 172.21.15.42:0/2908522050 shutdown_connections 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.903+0000 7f0525400640 1 -- 172.21.15.42:0/2908522050 wait complete. 2024-08-17T02:28:01.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.904+0000 7f0525400640 1 Processor -- start 2024-08-17T02:28:01.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.904+0000 7f0525400640 1 -- start start 2024-08-17T02:28:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.905+0000 7f0525400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f05200c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.905+0000 7f0525400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f0520154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.905+0000 7f0525400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05201589a0 0x7f0520154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.905+0000 7f0525400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520167c70 con 0x7f05200acf10 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.905+0000 7f0525400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05201685e0 con 0x7f05201589a0 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.905+0000 7f0525400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520167990 con 0x7f05200afca0 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f05200c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f05200c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57370/0 (socket says 172.21.15.42:57370) 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 -- 172.21.15.42:0/312577682 learned_addr learned my addr 172.21.15.42:0/312577682 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f0517e00640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f0520154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051f200640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05201589a0 0x7f0520154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 -- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 msgr2=0x7f0520154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f0520154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 -- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05201589a0 msgr2=0x7f0520154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05201589a0 0x7f0520154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 -- 172.21.15.42:0/312577682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009390 con 0x7f05200acf10 2024-08-17T02:28:01.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.906+0000 7f051e800640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f05200c3cf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f051000d1d0 tx=0x7f0510009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.907+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510015440 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.907+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000f040 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.907+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0520167f90 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.907+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05100157d0 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.907+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05200c4230 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.908+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0520167df0 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.909+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0510015bc0 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.909+0000 7f0516000640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f04fc065150 0x7f04fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.910+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0510082990 con 0x7f05200acf10 2024-08-17T02:28:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.910+0000 7f0517e00640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f04fc065150 0x7f04fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.910+0000 7f0517e00640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f04fc065150 0x7f04fc067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0508034000 tx=0x7f0508032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:01.913+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f051004ee40 con 0x7f05200acf10 2024-08-17T02:28:02.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.100+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0520063fb0 con 0x7f05200acf10 2024-08-17T02:28:02.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.100+0000 7f0516000640 1 -- 172.21.15.42:0/312577682 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f051001a020 con 0x7f05200acf10 2024-08-17T02:28:02.101 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:28:02.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f04fc065150 msgr2=0x7f04fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f04fc065150 0x7f04fc067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0508034000 tx=0x7f0508032000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 msgr2=0x7f05200c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f05200c3cf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f051000d1d0 tx=0x7f0510009a90 comp rx=0 tx=0).stop 2024-08-17T02:28:02.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 shutdown_connections 2024-08-17T02:28:02.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f04fc065150 0x7f04fc067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05201589a0 0x7f0520154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05200afca0 0x7f0520154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 --2- 172.21.15.42:0/312577682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05200acf10 0x7f05200c3cf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 >> 172.21.15.42:0/312577682 conn(0x7f0520066e60 msgr2=0x7f05200cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 shutdown_connections 2024-08-17T02:28:02.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.103+0000 7f0525400640 1 -- 172.21.15.42:0/312577682 wait complete. 2024-08-17T02:28:02.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:02.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.273+0000 7fab6ac00640 1 Processor -- start 2024-08-17T02:28:02.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.273+0000 7fab6ac00640 1 -- start start 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab6ac00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fab640aea20 0x7fab640aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab6ac00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640ca8e0 0x7fab640cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab6ac00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab640af3a0 con 0x7fab64158b90 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab6ac00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640afd20 con 0x7fab640aea20 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab6ac00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640affe0 con 0x7fab640ca8e0 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab63400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fab640aea20 0x7fab640aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab63400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fab640aea20 0x7fab640aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57378/0 (socket says 172.21.15.42:57378) 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.274+0000 7fab63400640 1 -- 172.21.15.42:0/439956907 learned_addr learned my addr 172.21.15.42:0/439956907 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:02.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.275+0000 7fab68c00640 1 --2- 172.21.15.42:0/439956907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640ca8e0 0x7fab640cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.275+0000 7fab63400640 1 -- 172.21.15.42:0/439956907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640ca8e0 msgr2=0x7fab640cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.275+0000 7fab63400640 1 --2- 172.21.15.42:0/439956907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640ca8e0 0x7fab640cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.275+0000 7fab63400640 1 -- 172.21.15.42:0/439956907 >> v1:172.21.15.62:6789/0 conn(0x7fab64158b90 legacy=0x7fab640b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.275+0000 7fab63400640 1 -- 172.21.15.42:0/439956907 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640b02c0 con 0x7fab640aea20 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.276+0000 7fab63400640 1 --2- 172.21.15.42:0/439956907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab640aea20 0x7fab640aee60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab50009910 tx=0x7fab500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cf66671b5c0dcf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.276+0000 7fab62a00640 1 -- 172.21.15.42:0/439956907 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5002ae40 con 0x7fab640aea20 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.276+0000 7fab62a00640 1 -- 172.21.15.42:0/439956907 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50032440 con 0x7fab640aea20 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.276+0000 7fab62a00640 1 -- 172.21.15.42:0/439956907 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50032820 con 0x7fab640aea20 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 -- 172.21.15.42:0/439956907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab640aea20 msgr2=0x7fab640aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 --2- 172.21.15.42:0/439956907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab640aea20 0x7fab640aee60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fab50009910 tx=0x7fab500091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 -- 172.21.15.42:0/439956907 shutdown_connections 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 --2- 172.21.15.42:0/439956907 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640ca8e0 0x7fab640cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 --2- 172.21.15.42:0/439956907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab640aea20 0x7fab640aee60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 -- 172.21.15.42:0/439956907 >> 172.21.15.42:0/439956907 conn(0x7fab6406e590 msgr2=0x7fab6406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 -- 172.21.15.42:0/439956907 shutdown_connections 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.277+0000 7fab6ac00640 1 -- 172.21.15.42:0/439956907 wait complete. 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.278+0000 7fab6ac00640 1 Processor -- start 2024-08-17T02:28:02.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.278+0000 7fab6ac00640 1 -- start start 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab6ac00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640aea20 0x7fab640c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab6ac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab640ca8e0 0x7fab640c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab6ac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 0x7fab6414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab6ac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641501b0 con 0x7fab64158b90 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab6ac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640d0300 con 0x7fab640ca8e0 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab6ac00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab640c9fc0 con 0x7fab640aea20 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab68c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 0x7fab6414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab68c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 0x7fab6414e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57392/0 (socket says 172.21.15.42:57392) 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab68c00640 1 -- 172.21.15.42:0/556104793 learned_addr learned my addr 172.21.15.42:0/556104793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.279+0000 7fab63400640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab640ca8e0 0x7fab640c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab63e00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640aea20 0x7fab640c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab68c00640 1 -- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640aea20 msgr2=0x7fab640c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab68c00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640aea20 0x7fab640c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab68c00640 1 -- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab640ca8e0 msgr2=0x7fab640c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab68c00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab640ca8e0 0x7fab640c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab68c00640 1 -- 172.21.15.42:0/556104793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab50009450 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab68c00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 0x7fab6414e0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009e90 tx=0x7fab5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00ce10 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c00f040 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab640cf6f0 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.280+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0146d0 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.281+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab640cfcb0 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.282+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab640d04b0 con 0x7fab64158b90 2024-08-17T02:28:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.282+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fab5c014a80 con 0x7fab64158b90 2024-08-17T02:28:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.283+0000 7fab5b400640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab44065150 0x7fab44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.283+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab5c083060 con 0x7fab64158b90 2024-08-17T02:28:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.283+0000 7fab63e00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab44065150 0x7fab44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.284+0000 7fab63e00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab44065150 0x7fab44067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab64066ff0 tx=0x7fab54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.287+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fab640d04b0 con 0x7fab64158b90 2024-08-17T02:28:02.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.470+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab640d04b0 con 0x7fab64158b90 2024-08-17T02:28:02.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.470+0000 7fab5b400640 1 -- 172.21.15.42:0/556104793 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab640d04b0 con 0x7fab64158b90 2024-08-17T02:28:02.471 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:28:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.472+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab44065150 msgr2=0x7fab44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.472+0000 7fab6ac00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab44065150 0x7fab44067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab64066ff0 tx=0x7fab54009040 comp rx=0 tx=0).stop 2024-08-17T02:28:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.472+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 msgr2=0x7fab6414e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.472+0000 7fab6ac00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 0x7fab6414e0e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009e90 tx=0x7fab5c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 shutdown_connections 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab44065150 0x7fab44067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab64158b90 0x7fab6414e0e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab640ca8e0 0x7fab640c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 --2- 172.21.15.42:0/556104793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab640aea20 0x7fab640c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 >> 172.21.15.42:0/556104793 conn(0x7fab6406e590 msgr2=0x7fab640cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 shutdown_connections 2024-08-17T02:28:02.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.473+0000 7fab6ac00640 1 -- 172.21.15.42:0/556104793 wait complete. 2024-08-17T02:28:02.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:02.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.639+0000 7f21d3e00640 1 Processor -- start 2024-08-17T02:28:02.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.640+0000 7f21d3e00640 1 -- start start 2024-08-17T02:28:02.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21d3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f21d40ca430 0x7f21d40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d41552d0 0x7f21d4155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21d3e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d40cb180 con 0x7f21d40ad790 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21d3e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40af530 con 0x7f21d40ca430 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21d3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40ca8e0 con 0x7f21d41552d0 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21cbe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f21d40ca430 0x7f21d40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21cbe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f21d40ca430 0x7f21d40adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57396/0 (socket says 172.21.15.42:57396) 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21cbe00640 1 -- 172.21.15.42:0/3335033449 learned_addr learned my addr 172.21.15.42:0/3335033449 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.641+0000 7f21d3400640 1 --2- 172.21.15.42:0/3335033449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d41552d0 0x7f21d4155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.642+0000 7f21cbe00640 1 -- 172.21.15.42:0/3335033449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d41552d0 msgr2=0x7f21d4155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.642+0000 7f21cbe00640 1 --2- 172.21.15.42:0/3335033449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d41552d0 0x7f21d4155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.642+0000 7f21cbe00640 1 -- 172.21.15.42:0/3335033449 >> v1:172.21.15.62:6789/0 conn(0x7f21d40ad790 legacy=0x7f21d40c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.642+0000 7f21cbe00640 1 -- 172.21.15.42:0/3335033449 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d40cabc0 con 0x7f21d40ca430 2024-08-17T02:28:02.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.643+0000 7f21cbe00640 1 --2- 172.21.15.42:0/3335033449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d40ca430 0x7f21d40adb60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009910 tx=0x7f21bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b6deb778d71234 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.643+0000 7f21d2000640 1 -- 172.21.15.42:0/3335033449 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02adb0 con 0x7f21d40ca430 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.643+0000 7f21d2000640 1 -- 172.21.15.42:0/3335033449 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc032440 con 0x7f21d40ca430 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.643+0000 7f21d2000640 1 -- 172.21.15.42:0/3335033449 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc032820 con 0x7f21d40ca430 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 -- 172.21.15.42:0/3335033449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d40ca430 msgr2=0x7f21d40adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 --2- 172.21.15.42:0/3335033449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d40ca430 0x7f21d40adb60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009910 tx=0x7f21bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 -- 172.21.15.42:0/3335033449 shutdown_connections 2024-08-17T02:28:02.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 --2- 172.21.15.42:0/3335033449 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d41552d0 0x7f21d4155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 --2- 172.21.15.42:0/3335033449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d40ca430 0x7f21d40adb60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 -- 172.21.15.42:0/3335033449 >> 172.21.15.42:0/3335033449 conn(0x7f21d4062af0 msgr2=0x7f21d4062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 -- 172.21.15.42:0/3335033449 shutdown_connections 2024-08-17T02:28:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.644+0000 7f21d3e00640 1 -- 172.21.15.42:0/3335033449 wait complete. 2024-08-17T02:28:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.645+0000 7f21d3e00640 1 Processor -- start 2024-08-17T02:28:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.645+0000 7f21d3e00640 1 -- start start 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d40ad790 0x7f21d41508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d40ca430 0x7f21d416ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 0x7f21d4149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4150f70 con 0x7f21d41552d0 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4155e90 con 0x7f21d40ad790 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4151150 con 0x7f21d40ca430 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 0x7f21d4149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 0x7f21d4149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57408/0 (socket says 172.21.15.42:57408) 2024-08-17T02:28:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d3400640 1 -- 172.21.15.42:0/444109709 learned_addr learned my addr 172.21.15.42:0/444109709 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21cbe00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d40ca430 0x7f21d416ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.646+0000 7f21d2a00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d40ad790 0x7f21d41508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3400640 1 -- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d40ca430 msgr2=0x7f21d416ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3400640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d40ca430 0x7f21d416ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3400640 1 -- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d40ad790 msgr2=0x7f21d41508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3400640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d40ad790 0x7f21d41508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3400640 1 -- 172.21.15.42:0/444109709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009450 con 0x7f21d41552d0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3400640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 0x7f21d4149dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009df0 tx=0x7f21cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00cd40 con 0x7f21d41552d0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21cc00f040 con 0x7f21d41552d0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0146d0 con 0x7f21d41552d0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.647+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d4151430 con 0x7f21d41552d0 2024-08-17T02:28:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.648+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4156410 con 0x7f21d41552d0 2024-08-17T02:28:02.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.649+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4070720 con 0x7f21d41552d0 2024-08-17T02:28:02.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.649+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f21cc014a80 con 0x7f21d41552d0 2024-08-17T02:28:02.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.650+0000 7f21ca000640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f21b0065150 0x7f21b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.650+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21cc082e40 con 0x7f21d41552d0 2024-08-17T02:28:02.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.651+0000 7f21d2a00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f21b0065150 0x7f21b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.651+0000 7f21d2a00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f21b0065150 0x7f21b0067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007fd0 tx=0x7f21c4007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.654+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f21cc050f10 con 0x7f21d41552d0 2024-08-17T02:28:02.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.873+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21d4159720 con 0x7f21d41552d0 2024-08-17T02:28:02.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.873+0000 7f21ca000640 1 -- 172.21.15.42:0/444109709 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f21cc018020 con 0x7f21d41552d0 2024-08-17T02:28:02.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:02.874 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:02.874 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:28:02.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f21b0065150 msgr2=0x7f21b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f21b0065150 0x7f21b0067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f21c4007fd0 tx=0x7f21c4007e30 comp rx=0 tx=0).stop 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 msgr2=0x7f21d4149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 0x7f21d4149dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009df0 tx=0x7f21cc00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 shutdown_connections 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f21b0065150 0x7f21b0067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21d41552d0 0x7f21d4149dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21d40ca430 0x7f21d416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 --2- 172.21.15.42:0/444109709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21d40ad790 0x7f21d41508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 >> 172.21.15.42:0/444109709 conn(0x7f21d4062af0 msgr2=0x7f21d4154660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 shutdown_connections 2024-08-17T02:28:02.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:02.876+0000 7f21d3e00640 1 -- 172.21.15.42:0/444109709 wait complete. 2024-08-17T02:28:02.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:03.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.042+0000 7f8d0f000640 1 Processor -- start 2024-08-17T02:28:03.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.042+0000 7f8d0f000640 1 -- start start 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.043+0000 7f8d0f000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8d080add30 0x7f8d08156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.043+0000 7f8d0f000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080cb160 con 0x7f8d080ad960 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.043+0000 7f8d0f000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080b0d10 con 0x7f8d080ca050 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.043+0000 7f8d0f000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080ca550 con 0x7f8d080add30 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d07e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8d080ad960 0x7f8d08156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35666/0 (socket says 172.21.15.42:35666) 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d07e00640 1 -- 172.21.15.42:0/3542952902 learned_addr learned my addr 172.21.15.42:0/3542952902 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d0d000640 1 --2- 172.21.15.42:0/3542952902 >> v2:172.21.15.42:3300/0 conn(0x7f8d080add30 0x7f8d08156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d06a00640 1 -- 172.21.15.42:0/3542952902 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957803807 0 0) 0x7f8d080cb160 con 0x7f8d080ad960 2024-08-17T02:28:03.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d0d000640 1 -- 172.21.15.42:0/3542952902 >> v1:172.21.15.62:6789/0 conn(0x7f8d080ca050 legacy=0x7f8d080aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d0d000640 1 -- 172.21.15.42:0/3542952902 >> v1:172.21.15.42:6789/0 conn(0x7f8d080ad960 legacy=0x7f8d08156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.044+0000 7f8d0d000640 1 -- 172.21.15.42:0/3542952902 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080ca830 con 0x7f8d080add30 2024-08-17T02:28:03.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.045+0000 7f8d0d000640 1 --2- 172.21.15.42:0/3542952902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d08156b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009de0 tx=0x7f8d00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5955653885b09cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.045+0000 7f8d06a00640 1 -- 172.21.15.42:0/3542952902 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00007550 con 0x7f8d080add30 2024-08-17T02:28:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.045+0000 7f8d06a00640 1 -- 172.21.15.42:0/3542952902 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0002d050 con 0x7f8d080add30 2024-08-17T02:28:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.045+0000 7f8d06a00640 1 -- 172.21.15.42:0/3542952902 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000078e0 con 0x7f8d080add30 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 -- 172.21.15.42:0/3542952902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 msgr2=0x7f8d08156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3542952902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d08156b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009de0 tx=0x7f8d00009780 comp rx=0 tx=0).stop 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 -- 172.21.15.42:0/3542952902 shutdown_connections 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3542952902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d08156b30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 -- 172.21.15.42:0/3542952902 >> 172.21.15.42:0/3542952902 conn(0x7f8d08066e60 msgr2=0x7f8d08067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 -- 172.21.15.42:0/3542952902 shutdown_connections 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.046+0000 7f8d0f000640 1 -- 172.21.15.42:0/3542952902 wait complete. 2024-08-17T02:28:03.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.047+0000 7f8d0f000640 1 Processor -- start 2024-08-17T02:28:03.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 -- start start 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d080ad960 0x7f8d08143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d0814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8d080ca050 0x7f8d080ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08157a80 con 0x7f8d080add30 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08143950 con 0x7f8d080ad960 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.048+0000 7f8d0f000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081588a0 con 0x7f8d080ca050 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d0814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d0814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57438/0 (socket says 172.21.15.42:57438) 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 -- 172.21.15.42:0/3229613653 learned_addr learned my addr 172.21.15.42:0/3229613653 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 -- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8d080ca050 msgr2=0x7f8d080ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07e00640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d080ad960 0x7f8d08143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d0d000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8d080ca050 0x7f8d080ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8d080ca050 0x7f8d080ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 -- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d080ad960 msgr2=0x7f8d08143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d080ad960 0x7f8d08143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 -- 172.21.15.42:0/3229613653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00009a20 con 0x7f8d080add30 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07e00640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d080ad960 0x7f8d08143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d0d000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8d080ca050 0x7f8d080ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.049+0000 7f8d07400640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d0814f8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c870 tx=0x7f8cf4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.050+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400a640 con 0x7f8d080add30 2024-08-17T02:28:03.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.050+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400a7c0 con 0x7f8d080add30 2024-08-17T02:28:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.050+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400ab80 con 0x7f8d080add30 2024-08-17T02:28:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.050+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08157c90 con 0x7f8d080add30 2024-08-17T02:28:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.050+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d08158250 con 0x7f8d080add30 2024-08-17T02:28:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.051+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08063fb0 con 0x7f8d080add30 2024-08-17T02:28:03.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.052+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8cf4012420 con 0x7f8d080add30 2024-08-17T02:28:03.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.053+0000 7f8cff400640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8ce8065150 0x7f8ce8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.053+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cf4082040 con 0x7f8d080add30 2024-08-17T02:28:03.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.053+0000 7f8d07e00640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8ce8065150 0x7f8ce8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.053+0000 7f8d07e00640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8ce8065150 0x7f8ce8067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8000c00 tx=0x7f8cf8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.056+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8cf4050100 con 0x7f8d080add30 2024-08-17T02:28:03.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.239+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d081589e0 con 0x7f8d080add30 2024-08-17T02:28:03.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.240+0000 7f8cff400640 1 -- 172.21.15.42:0/3229613653 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f8cf4053720 con 0x7f8d080add30 2024-08-17T02:28:03.241 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:03.241 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:03.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8ce8065150 msgr2=0x7f8ce8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8ce8065150 0x7f8ce8067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8000c00 tx=0x7f8cf8009040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 msgr2=0x7f8d0814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d0814f8b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c870 tx=0x7f8cf4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 shutdown_connections 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8ce8065150 0x7f8ce8067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8d080ca050 0x7f8d080ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d080add30 0x7f8d0814f8b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 --2- 172.21.15.42:0/3229613653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d080ad960 0x7f8d08143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 >> 172.21.15.42:0/3229613653 conn(0x7f8d08066e60 msgr2=0x7f8d0806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 shutdown_connections 2024-08-17T02:28:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.243+0000 7f8d0f000640 1 -- 172.21.15.42:0/3229613653 wait complete. 2024-08-17T02:28:03.258 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:03.258 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:03.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.408+0000 7f3f39200640 1 Processor -- start 2024-08-17T02:28:03.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.408+0000 7f3f39200640 1 -- start start 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f39200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f341590b0 0x7f3f340b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f39200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f340c92b0 con 0x7f3f340acf10 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f39200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f340ad480 con 0x7f3f340afca0 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f39200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340b0980 con 0x7f3f341590b0 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f32800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3f340acf10 0x7f3f340c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35682/0 (socket says 172.21.15.42:35682) 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f32800640 1 -- 172.21.15.42:0/3891379019 learned_addr learned my addr 172.21.15.42:0/3891379019 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f2be00640 1 --2- 172.21.15.42:0/3891379019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f341590b0 0x7f3f340b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136444577 0 0) 0x7f3f340c92b0 con 0x7f3f340acf10 2024-08-17T02:28:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.410+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f180034e0 con 0x7f3f340acf10 2024-08-17T02:28:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.411+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134222484 0 0) 0x7f3f340ad480 con 0x7f3f340afca0 2024-08-17T02:28:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.411+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f340c92b0 con 0x7f3f340afca0 2024-08-17T02:28:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.411+0000 7f3f2be00640 1 -- 172.21.15.42:0/3891379019 >> v1:172.21.15.62:6789/0 conn(0x7f3f340afca0 legacy=0x7f3f341589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.411+0000 7f3f2be00640 1 -- 172.21.15.42:0/3891379019 >> v1:172.21.15.42:6789/0 conn(0x7f3f340acf10 legacy=0x7f3f340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.411+0000 7f3f2be00640 1 -- 172.21.15.42:0/3891379019 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340ad760 con 0x7f3f341590b0 2024-08-17T02:28:03.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.412+0000 7f3f2be00640 1 --2- 172.21.15.42:0/3891379019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f341590b0 0x7f3f340b0070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009880 tx=0x7f3f1c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82e07ca8b4e4e45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.412+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c02ae10 con 0x7f3f341590b0 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.412+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c032440 con 0x7f3f341590b0 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.412+0000 7f3f31400640 1 -- 172.21.15.42:0/3891379019 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0327c0 con 0x7f3f341590b0 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 -- 172.21.15.42:0/3891379019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f341590b0 msgr2=0x7f3f340b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 --2- 172.21.15.42:0/3891379019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f341590b0 0x7f3f340b0070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009880 tx=0x7f3f1c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 -- 172.21.15.42:0/3891379019 shutdown_connections 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 --2- 172.21.15.42:0/3891379019 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f341590b0 0x7f3f340b0070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 -- 172.21.15.42:0/3891379019 >> 172.21.15.42:0/3891379019 conn(0x7f3f34066e60 msgr2=0x7f3f34067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 -- 172.21.15.42:0/3891379019 shutdown_connections 2024-08-17T02:28:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.413+0000 7f3f39200640 1 -- 172.21.15.42:0/3891379019 wait complete. 2024-08-17T02:28:03.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.414+0000 7f3f39200640 1 Processor -- start 2024-08-17T02:28:03.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.414+0000 7f3f39200640 1 -- start start 2024-08-17T02:28:03.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f39200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 0x7f3f3414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f39200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f340afca0 0x7f3f3413b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f39200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f341590b0 0x7f3f341523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f39200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3413b8b0 con 0x7f3f340acf10 2024-08-17T02:28:03.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f39200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3414e0a0 con 0x7f3f341590b0 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f39200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341528e0 con 0x7f3f340afca0 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f31e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 0x7f3f3414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f31e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 0x7f3f3414e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57448/0 (socket says 172.21.15.42:57448) 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f32800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f341590b0 0x7f3f341523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f31e00640 1 -- 172.21.15.42:0/2936090033 learned_addr learned my addr 172.21.15.42:0/2936090033 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.415+0000 7f3f2be00640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f340afca0 0x7f3f3413b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f31e00640 1 -- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f340afca0 msgr2=0x7f3f3413b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f31e00640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f340afca0 0x7f3f3413b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f31e00640 1 -- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f341590b0 msgr2=0x7f3f341523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f31e00640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f341590b0 0x7f3f341523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f31e00640 1 -- 172.21.15.42:0/2936090033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c009390 con 0x7f3f340acf10 2024-08-17T02:28:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f31e00640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 0x7f3f3414e530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400c590 tx=0x7f3f24007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24012630 con 0x7f3f340acf10 2024-08-17T02:28:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f240127b0 con 0x7f3f340acf10 2024-08-17T02:28:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24012bb0 con 0x7f3f340acf10 2024-08-17T02:28:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.416+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3414f9b0 con 0x7f3f340acf10 2024-08-17T02:28:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.417+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3414ff50 con 0x7f3f340acf10 2024-08-17T02:28:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.417+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f34063fb0 con 0x7f3f340acf10 2024-08-17T02:28:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.419+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f2401a3b0 con 0x7f3f340acf10 2024-08-17T02:28:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.419+0000 7f3f29600640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3f10065150 0x7f3f10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.420+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f240822f0 con 0x7f3f340acf10 2024-08-17T02:28:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.420+0000 7f3f2be00640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3f10065150 0x7f3f10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.420+0000 7f3f2be00640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3f10065150 0x7f3f10067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c034000 tx=0x7f3f1c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.423+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f240503c0 con 0x7f3f340acf10 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.650+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f340c9f70 con 0x7f3f340acf10 2024-08-17T02:28:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.651+0000 7f3f29600640 1 -- 172.21.15.42:0/2936090033 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7f3f240539e0 con 0x7f3f340acf10 2024-08-17T02:28:03.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:03.651 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:28:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3f10065150 msgr2=0x7f3f10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3f10065150 0x7f3f10067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c034000 tx=0x7f3f1c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 msgr2=0x7f3f3414e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 0x7f3f3414e530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400c590 tx=0x7f3f24007d80 comp rx=0 tx=0).stop 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 shutdown_connections 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3f10065150 0x7f3f10067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f341590b0 0x7f3f341523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f340afca0 0x7f3f3413b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 --2- 172.21.15.42:0/2936090033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f340acf10 0x7f3f3414e530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 >> 172.21.15.42:0/2936090033 conn(0x7f3f34066e60 msgr2=0x7f3f340ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 shutdown_connections 2024-08-17T02:28:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.653+0000 7f3f39200640 1 -- 172.21.15.42:0/2936090033 wait complete. 2024-08-17T02:28:03.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.819+0000 7fde46400640 1 Processor -- start 2024-08-17T02:28:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.819+0000 7fde46400640 1 -- start start 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.820+0000 7fde46400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde400afca0 0x7fde400b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.820+0000 7fde46400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fde400acf10 0x7fde40159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde46400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4015a4e0 con 0x7fde401589a0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde46400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde400b0980 con 0x7fde400acf10 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde46400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c92b0 con 0x7fde400afca0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde3fe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fde401589a0 0x7fde4006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35690/0 (socket says 172.21.15.42:35690) 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde3fe00640 1 -- 172.21.15.42:0/2158493002 learned_addr learned my addr 172.21.15.42:0/2158493002 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde37e00640 1 --2- 172.21.15.42:0/2158493002 >> v2:172.21.15.62:3300/0 conn(0x7fde400acf10 0x7fde40159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde3f400640 1 --2- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde400afca0 0x7fde400b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde3ea00640 1 -- 172.21.15.42:0/2158493002 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261540086 0 0) 0x7fde38001490 con 0x7fde401589a0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde3ea00640 1 -- 172.21.15.42:0/2158493002 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde240034e0 con 0x7fde401589a0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde37e00640 1 -- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde400afca0 msgr2=0x7fde400b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde37e00640 1 --2- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde400afca0 0x7fde400b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde37e00640 1 -- 172.21.15.42:0/2158493002 >> v1:172.21.15.42:6789/0 conn(0x7fde401589a0 legacy=0x7fde4006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.821+0000 7fde37e00640 1 -- 172.21.15.42:0/2158493002 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400ad480 con 0x7fde400acf10 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.823+0000 7fde37e00640 1 --2- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40159fa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde28009880 tx=0x7fde280090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbcc9788fab1b66d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.823+0000 7fde3ea00640 1 -- 172.21.15.42:0/2158493002 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2802ad90 con 0x7fde400acf10 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.823+0000 7fde3ea00640 1 -- 172.21.15.42:0/2158493002 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28032440 con 0x7fde400acf10 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.823+0000 7fde3ea00640 1 -- 172.21.15.42:0/2158493002 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28032820 con 0x7fde400acf10 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.823+0000 7fde46400640 1 -- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 msgr2=0x7fde40159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.823+0000 7fde46400640 1 --2- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40159fa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde28009880 tx=0x7fde280090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.824+0000 7fde46400640 1 -- 172.21.15.42:0/2158493002 shutdown_connections 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.824+0000 7fde46400640 1 --2- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40159fa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.824+0000 7fde46400640 1 --2- 172.21.15.42:0/2158493002 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde400afca0 0x7fde400b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.824+0000 7fde46400640 1 -- 172.21.15.42:0/2158493002 >> 172.21.15.42:0/2158493002 conn(0x7fde40066e60 msgr2=0x7fde40067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.824+0000 7fde46400640 1 -- 172.21.15.42:0/2158493002 shutdown_connections 2024-08-17T02:28:03.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.824+0000 7fde46400640 1 -- 172.21.15.42:0/2158493002 wait complete. 2024-08-17T02:28:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.825+0000 7fde46400640 1 Processor -- start 2024-08-17T02:28:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.825+0000 7fde46400640 1 -- start start 2024-08-17T02:28:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde46400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde46400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 0x7fde401564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde46400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde401589a0 0x7fde400c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde46400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde40156ac0 con 0x7fde400afca0 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde46400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde40156da0 con 0x7fde400acf10 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde46400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde40157080 con 0x7fde401589a0 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 0x7fde401564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 0x7fde401564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57458/0 (socket says 172.21.15.42:57458) 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.826+0000 7fde37e00640 1 -- 172.21.15.42:0/1976277580 learned_addr learned my addr 172.21.15.42:0/1976277580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde3f400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde3fe00640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde401589a0 0x7fde400c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde37e00640 1 -- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde401589a0 msgr2=0x7fde400c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde37e00640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde401589a0 0x7fde400c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde37e00640 1 -- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 msgr2=0x7fde40155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde37e00640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde37e00640 1 -- 172.21.15.42:0/1976277580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28009390 con 0x7fde400afca0 2024-08-17T02:28:03.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde3fe00640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde401589a0 0x7fde400c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:03.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde37e00640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 0x7fde401564b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde28009360 tx=0x7fde28032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.827+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28031c20 con 0x7fde400afca0 2024-08-17T02:28:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.828+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28031d80 con 0x7fde400afca0 2024-08-17T02:28:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.828+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde40157360 con 0x7fde400afca0 2024-08-17T02:28:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.828+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2803d670 con 0x7fde400afca0 2024-08-17T02:28:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.828+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde401535b0 con 0x7fde400afca0 2024-08-17T02:28:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.829+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde40063fb0 con 0x7fde400afca0 2024-08-17T02:28:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.829+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde28039040 con 0x7fde400afca0 2024-08-17T02:28:03.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.830+0000 7fde36a00640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde1c065150 0x7fde1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.830+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde280a25e0 con 0x7fde400afca0 2024-08-17T02:28:03.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.830+0000 7fde3f400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde1c065150 0x7fde1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.831+0000 7fde3f400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde1c065150 0x7fde1c067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde400b06a0 tx=0x7fde300090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:03.834+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde280706b0 con 0x7fde400afca0 2024-08-17T02:28:04.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.053+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde40067b70 con 0x7fde400afca0 2024-08-17T02:28:04.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.053+0000 7fde36a00640 1 -- 172.21.15.42:0/1976277580 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4588 (secure 0 0 0) 0x7fde28073cd0 con 0x7fde400afca0 2024-08-17T02:28:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:04.054 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/398654318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":398654318},{"type":"v1","addr":"172.21.15.62:6833","nonce":398654318}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2263128723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2263128723},{"type":"v1","addr":"172.21.15.42:6837","nonce":2263128723}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1243324975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":1243324975},{"type":"v1","addr":"172.21.15.62:6835","nonce":1243324975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:24.861445+0000","modified":"2024-08-17T02:27:28.444016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1740596523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1740596523},{"type":"v1","addr":"172.21.15.42:6835","nonce":1740596523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:04.054 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2024-08-17T02:28:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde1c065150 msgr2=0x7fde1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde1c065150 0x7fde1c067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fde400b06a0 tx=0x7fde300090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 msgr2=0x7fde401564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 0x7fde401564b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fde28009360 tx=0x7fde28032000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 shutdown_connections 2024-08-17T02:28:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fde1c065150 0x7fde1c067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde401589a0 0x7fde400c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde400afca0 0x7fde401564b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 --2- 172.21.15.42:0/1976277580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde400acf10 0x7fde40155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.055+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 >> 172.21.15.42:0/1976277580 conn(0x7fde40066e60 msgr2=0x7fde400c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.056+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 shutdown_connections 2024-08-17T02:28:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.056+0000 7fde46400640 1 -- 172.21.15.42:0/1976277580 wait complete. 2024-08-17T02:28:04.070 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:04.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.220+0000 7f8a28a00640 1 Processor -- start 2024-08-17T02:28:04.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.221+0000 7f8a28a00640 1 -- start start 2024-08-17T02:28:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a28a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8a24158c90 0x7f8a240ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a28a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240ccc10 0x7f8a240af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a28a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240cf600 con 0x7f8a240cadc0 2024-08-17T02:28:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a28a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240cea90 con 0x7f8a24158c90 2024-08-17T02:28:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a28a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240ced30 con 0x7f8a240ccc10 2024-08-17T02:28:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a23400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8a24158c90 0x7f8a240ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a1be00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8a240cadc0 0x7f8a240cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35694/0 (socket says 172.21.15.42:35694) 2024-08-17T02:28:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a1be00640 1 -- 172.21.15.42:0/3608672235 learned_addr learned my addr 172.21.15.42:0/3608672235 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.222+0000 7f8a23e00640 1 --2- 172.21.15.42:0/3608672235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240ccc10 0x7f8a240af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.223+0000 7f8a23400640 1 -- 172.21.15.42:0/3608672235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240ccc10 msgr2=0x7f8a240af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.223+0000 7f8a23400640 1 --2- 172.21.15.42:0/3608672235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240ccc10 0x7f8a240af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.223+0000 7f8a23400640 1 -- 172.21.15.42:0/3608672235 >> v1:172.21.15.42:6789/0 conn(0x7f8a240cadc0 legacy=0x7f8a240cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.223+0000 7f8a23400640 1 -- 172.21.15.42:0/3608672235 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240cefd0 con 0x7f8a24158c90 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.223+0000 7f8a22a00640 1 -- 172.21.15.42:0/3608672235 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349026063 0 0) 0x7f8a240cf600 con 0x7f8a240cadc0 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.224+0000 7f8a23400640 1 --2- 172.21.15.42:0/3608672235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a24158c90 0x7f8a240ce180 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009850 tx=0x7f8a140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9368db4d44c1507 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.224+0000 7f8a22a00640 1 -- 172.21.15.42:0/3608672235 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1402ad80 con 0x7f8a24158c90 2024-08-17T02:28:04.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.224+0000 7f8a22a00640 1 -- 172.21.15.42:0/3608672235 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14032440 con 0x7f8a24158c90 2024-08-17T02:28:04.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.224+0000 7f8a22a00640 1 -- 172.21.15.42:0/3608672235 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140327e0 con 0x7f8a24158c90 2024-08-17T02:28:04.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.224+0000 7f8a28a00640 1 -- 172.21.15.42:0/3608672235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a24158c90 msgr2=0x7f8a240ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.224+0000 7f8a28a00640 1 --2- 172.21.15.42:0/3608672235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a24158c90 0x7f8a240ce180 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009850 tx=0x7f8a140090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.225+0000 7f8a28a00640 1 -- 172.21.15.42:0/3608672235 shutdown_connections 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.225+0000 7f8a28a00640 1 --2- 172.21.15.42:0/3608672235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240ccc10 0x7f8a240af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.225+0000 7f8a28a00640 1 --2- 172.21.15.42:0/3608672235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a24158c90 0x7f8a240ce180 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.225+0000 7f8a28a00640 1 -- 172.21.15.42:0/3608672235 >> 172.21.15.42:0/3608672235 conn(0x7f8a24087a80 msgr2=0x7f8a2406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.225+0000 7f8a28a00640 1 -- 172.21.15.42:0/3608672235 shutdown_connections 2024-08-17T02:28:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.225+0000 7f8a28a00640 1 -- 172.21.15.42:0/3608672235 wait complete. 2024-08-17T02:28:04.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.226+0000 7f8a28a00640 1 Processor -- start 2024-08-17T02:28:04.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.226+0000 7f8a28a00640 1 -- start start 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a28a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240cadc0 0x7f8a2414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a28a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 0x7f8a2415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a28a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a24158c90 0x7f8a2415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a28a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2415e300 con 0x7f8a240ccc10 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a28a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2415d6f0 con 0x7f8a24158c90 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a28a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2415d9d0 con 0x7f8a240cadc0 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 0x7f8a2415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 0x7f8a2415e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57472/0 (socket says 172.21.15.42:57472) 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.227+0000 7f8a1be00640 1 -- 172.21.15.42:0/2169247493 learned_addr learned my addr 172.21.15.42:0/2169247493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a23400640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240cadc0 0x7f8a2414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a23e00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a24158c90 0x7f8a2415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1be00640 1 -- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240cadc0 msgr2=0x7f8a2414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1be00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240cadc0 0x7f8a2414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1be00640 1 -- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a24158c90 msgr2=0x7f8a2415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1be00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a24158c90 0x7f8a2415ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1be00640 1 -- 172.21.15.42:0/2169247493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009390 con 0x7f8a240ccc10 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a23e00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a24158c90 0x7f8a2415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1be00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 0x7f8a2415e900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c5e0 tx=0x7f8a0c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c005aa0 con 0x7f8a240ccc10 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c005c00 con 0x7f8a240ccc10 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0070f0 con 0x7f8a240ccc10 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2415dcb0 con 0x7f8a240ccc10 2024-08-17T02:28:04.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.228+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a24150370 con 0x7f8a240ccc10 2024-08-17T02:28:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.230+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a24070720 con 0x7f8a240ccc10 2024-08-17T02:28:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.230+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8a0c007520 con 0x7f8a240ccc10 2024-08-17T02:28:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.231+0000 7f8a1aa00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8a00065150 0x7f8a00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.231+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a0c081ff0 con 0x7f8a240ccc10 2024-08-17T02:28:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.231+0000 7f8a23400640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8a00065150 0x7f8a00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.232+0000 7f8a23400640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8a00065150 0x7f8a00067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a14034000 tx=0x7f8a14032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.235+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8a0c0500f0 con 0x7f8a240ccc10 2024-08-17T02:28:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.418+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a24155ef0 con 0x7f8a240ccc10 2024-08-17T02:28:04.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.419+0000 7f8a1aa00640 1 -- 172.21.15.42:0/2169247493 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f8a0c053710 con 0x7f8a240ccc10 2024-08-17T02:28:04.420 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:04.420 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:27:26.431005+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:22.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:23.849107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8a00065150 msgr2=0x7f8a00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8a00065150 0x7f8a00067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8a14034000 tx=0x7f8a14032000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 msgr2=0x7f8a2415e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 0x7f8a2415e900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c5e0 tx=0x7f8a0c007d60 comp rx=0 tx=0).stop 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 shutdown_connections 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8a00065150 0x7f8a00067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a24158c90 0x7f8a2415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a240ccc10 0x7f8a2415e900 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 --2- 172.21.15.42:0/2169247493 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a240cadc0 0x7f8a2414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 >> 172.21.15.42:0/2169247493 conn(0x7f8a24087a80 msgr2=0x7f8a24156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 shutdown_connections 2024-08-17T02:28:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.421+0000 7f8a28a00640 1 -- 172.21.15.42:0/2169247493 wait complete. 2024-08-17T02:28:04.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:28:04.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.589+0000 7f8b4de00640 1 Processor -- start 2024-08-17T02:28:04.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.589+0000 7f8b4de00640 1 -- start start 2024-08-17T02:28:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b4de00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8b480afca0 0x7f8b480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b4de00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b480acf10 0x7f8b48159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b4de00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b481589a0 0x7f8b48158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b4de00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480b0980 con 0x7f8b480acf10 2024-08-17T02:28:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b4de00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4815a4e0 con 0x7f8b480afca0 2024-08-17T02:28:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b4de00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c92b0 con 0x7f8b481589a0 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b46000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b480acf10 0x7f8b48159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b46000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b480acf10 0x7f8b48159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57484/0 (socket says 172.21.15.42:57484) 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b46000640 1 -- 172.21.15.42:0/2855662974 learned_addr learned my addr 172.21.15.42:0/2855662974 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b47400640 1 --2- 172.21.15.42:0/2855662974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b481589a0 0x7f8b48158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.590+0000 7f8b46a00640 1 --2- 172.21.15.42:0/2855662974 >> v2:172.21.15.62:3300/0 conn(0x7f8b480afca0 0x7f8b480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.591+0000 7f8b46000640 1 -- 172.21.15.42:0/2855662974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b481589a0 msgr2=0x7f8b48158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.591+0000 7f8b46000640 1 --2- 172.21.15.42:0/2855662974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b481589a0 0x7f8b48158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.591+0000 7f8b46000640 1 -- 172.21.15.42:0/2855662974 >> v2:172.21.15.62:3300/0 conn(0x7f8b480afca0 msgr2=0x7f8b480b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.591+0000 7f8b46000640 1 --2- 172.21.15.42:0/2855662974 >> v2:172.21.15.62:3300/0 conn(0x7f8b480afca0 0x7f8b480b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.591+0000 7f8b46000640 1 -- 172.21.15.42:0/2855662974 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48159360 con 0x7f8b480acf10 2024-08-17T02:28:04.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.592+0000 7f8b46000640 1 --2- 172.21.15.42:0/2855662974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480acf10 0x7f8b48159fa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b48067e40 tx=0x7f8b340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c2928e3b406263 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.592+0000 7f8b45600640 1 -- 172.21.15.42:0/2855662974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3402add0 con 0x7f8b480acf10 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.592+0000 7f8b45600640 1 -- 172.21.15.42:0/2855662974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34032440 con 0x7f8b480acf10 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.592+0000 7f8b45600640 1 -- 172.21.15.42:0/2855662974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34032820 con 0x7f8b480acf10 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.592+0000 7f8b4de00640 1 -- 172.21.15.42:0/2855662974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480acf10 msgr2=0x7f8b48159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.592+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2855662974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480acf10 0x7f8b48159fa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b48067e40 tx=0x7f8b340091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 -- 172.21.15.42:0/2855662974 shutdown_connections 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2855662974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480acf10 0x7f8b48159fa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2855662974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b481589a0 0x7f8b48158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2855662974 >> v2:172.21.15.62:3300/0 conn(0x7f8b480afca0 0x7f8b480b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 -- 172.21.15.42:0/2855662974 >> 172.21.15.42:0/2855662974 conn(0x7f8b48066e60 msgr2=0x7f8b48067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 -- 172.21.15.42:0/2855662974 shutdown_connections 2024-08-17T02:28:04.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.593+0000 7f8b4de00640 1 -- 172.21.15.42:0/2855662974 wait complete. 2024-08-17T02:28:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.594+0000 7f8b4de00640 1 Processor -- start 2024-08-17T02:28:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.594+0000 7f8b4de00640 1 -- start start 2024-08-17T02:28:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b4de00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b480acf10 0x7f8b48169b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b4de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 0x7f8b48146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b4de00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b481589a0 0x7f8b4815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b4de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481525a0 con 0x7f8b480afca0 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b4de00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4816a080 con 0x7f8b481589a0 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b4de00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b48146980 con 0x7f8b480acf10 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b46000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 0x7f8b48146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b46000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 0x7f8b48146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57490/0 (socket says 172.21.15.42:57490) 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b46000640 1 -- 172.21.15.42:0/2233162895 learned_addr learned my addr 172.21.15.42:0/2233162895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b46a00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b480acf10 0x7f8b48169b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.595+0000 7f8b47400640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b481589a0 0x7f8b4815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46000640 1 -- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b480acf10 msgr2=0x7f8b48169b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46000640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b480acf10 0x7f8b48169b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46000640 1 -- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b481589a0 msgr2=0x7f8b4815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46000640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b481589a0 0x7f8b4815ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46000640 1 -- 172.21.15.42:0/2233162895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34009450 con 0x7f8b480afca0 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b47400640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b481589a0 0x7f8b4815ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46a00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b480acf10 0x7f8b48169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b46000640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 0x7f8b48146440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009940 tx=0x7f8b34032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34000d10 con 0x7f8b480afca0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34031de0 con 0x7f8b480afca0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3403d650 con 0x7f8b480afca0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b48154f90 con 0x7f8b480afca0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.596+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b481551e0 con 0x7f8b480afca0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.598+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b48063fb0 con 0x7f8b480afca0 2024-08-17T02:28:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.598+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b34039040 con 0x7f8b480afca0 2024-08-17T02:28:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.599+0000 7f8b3e000640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8b28065150 0x7f8b28067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.599+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b340a2820 con 0x7f8b480afca0 2024-08-17T02:28:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.599+0000 7f8b46a00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8b28065150 0x7f8b28067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.600+0000 7f8b46a00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8b28065150 0x7f8b28067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800bb80 tx=0x7f8b38008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.603+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b34070840 con 0x7f8b480afca0 2024-08-17T02:28:04.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.822+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8b48158fb0 con 0x7f8b480afca0 2024-08-17T02:28:04.823 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-08-17T02:28:04.823+0000 7f3018a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.827+0000 7f8b3e000640 1 -- 172.21.15.42:0/2233162895 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8b34042090 con 0x7f8b480afca0 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8b28065150 msgr2=0x7f8b28067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8b28065150 0x7f8b28067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800bb80 tx=0x7f8b38008040 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 msgr2=0x7f8b48146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 0x7f8b48146440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009940 tx=0x7f8b34032000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 shutdown_connections 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8b28065150 0x7f8b28067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b481589a0 0x7f8b4815ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480afca0 0x7f8b48146440 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 --2- 172.21.15.42:0/2233162895 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b480acf10 0x7f8b48169b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.829+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 >> 172.21.15.42:0/2233162895 conn(0x7f8b48066e60 msgr2=0x7f8b48069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.830+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 shutdown_connections 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:04.830+0000 7f8b4de00640 1 -- 172.21.15.42:0/2233162895 wait complete. 2024-08-17T02:28:04.833 INFO:tasks.ceph.mds.a.smithi042.stderr: -2078> 2024-08-17T02:27:28.168+0000 7f0162800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:04.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:28:04.872 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-08-17T02:28:05.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.000+0000 7f99e7200640 1 Processor -- start 2024-08-17T02:28:05.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.000+0000 7f99e7200640 1 -- start start 2024-08-17T02:28:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e7200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f99e814c9e0 0x7f99e80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e7200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e7200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f99e80ad220 0x7f99e8156e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e7200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80ad6a0 con 0x7f99e80ad220 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e7200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80696e0 con 0x7f99e814c9e0 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e7200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80699c0 con 0x7f99e80cc3d0 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f99e80ad220 0x7f99e8156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f99e80ad220 0x7f99e8156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57520/0 (socket says 172.21.15.42:57520) 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 -- 172.21.15.42:0/3411676521 learned_addr learned my addr 172.21.15.42:0/3411676521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e5e00640 1 --2- 172.21.15.42:0/3411676521 >> v2:172.21.15.62:3300/0 conn(0x7f99e814c9e0 0x7f99e80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99dfe00640 1 --2- 172.21.15.42:0/3411676521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 -- 172.21.15.42:0/3411676521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 msgr2=0x7f99e80acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 --2- 172.21.15.42:0/3411676521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 -- 172.21.15.42:0/3411676521 >> v2:172.21.15.62:3300/0 conn(0x7f99e814c9e0 msgr2=0x7f99e80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 --2- 172.21.15.42:0/3411676521 >> v2:172.21.15.62:3300/0 conn(0x7f99e814c9e0 0x7f99e80cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.002+0000 7f99e6800640 1 -- 172.21.15.42:0/3411676521 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8069ca0 con 0x7f99e80ad220 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.003+0000 7f99e6800640 1 --2- 172.21.15.42:0/3411676521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8156e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99e806c940 tx=0x7f99e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a8aa88b205cee2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e5400640 1 -- 172.21.15.42:0/3411676521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0031400 con 0x7f99e80ad220 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e5400640 1 -- 172.21.15.42:0/3411676521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e002d050 con 0x7f99e80ad220 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e5400640 1 -- 172.21.15.42:0/3411676521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00317d0 con 0x7f99e80ad220 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 -- 172.21.15.42:0/3411676521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 msgr2=0x7f99e8156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 --2- 172.21.15.42:0/3411676521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8156e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f99e806c940 tx=0x7f99e0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 -- 172.21.15.42:0/3411676521 shutdown_connections 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 --2- 172.21.15.42:0/3411676521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8156e50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 --2- 172.21.15.42:0/3411676521 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 --2- 172.21.15.42:0/3411676521 >> v2:172.21.15.62:3300/0 conn(0x7f99e814c9e0 0x7f99e80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 -- 172.21.15.42:0/3411676521 >> 172.21.15.42:0/3411676521 conn(0x7f99e8067930 msgr2=0x7f99e80cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 -- 172.21.15.42:0/3411676521 shutdown_connections 2024-08-17T02:28:05.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.004+0000 7f99e7200640 1 -- 172.21.15.42:0/3411676521 wait complete. 2024-08-17T02:28:05.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.006+0000 7f99e7200640 1 Processor -- start 2024-08-17T02:28:05.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.006+0000 7f99e7200640 1 -- start start 2024-08-17T02:28:05.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e7200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99e814c9e0 0x7f99e8140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e814ea50 con 0x7f99e80ad220 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e814ed30 con 0x7f99e814c9e0 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e7200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e814f010 con 0x7f99e80cc3d0 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8144bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57522/0 (socket says 172.21.15.42:57522) 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 -- 172.21.15.42:0/1687385052 learned_addr learned my addr 172.21.15.42:0/1687385052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99dfe00640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e6800640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99e814c9e0 0x7f99e8140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 -- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 msgr2=0x7f99e80afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 -- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99e814c9e0 msgr2=0x7f99e8140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99e814c9e0 0x7f99e8140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.007+0000 7f99e5e00640 1 -- 172.21.15.42:0/1687385052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009ae0 con 0x7f99e80ad220 2024-08-17T02:28:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.008+0000 7f99e5e00640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8144bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99d800d890 tx=0x7f99d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.008+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800de20 con 0x7f99e80ad220 2024-08-17T02:28:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.008+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80098b0 con 0x7f99e80ad220 2024-08-17T02:28:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.008+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8009c50 con 0x7f99e80ad220 2024-08-17T02:28:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.008+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e814f2f0 con 0x7f99e80ad220 2024-08-17T02:28:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.008+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8145100 con 0x7f99e80ad220 2024-08-17T02:28:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.009+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e814f770 con 0x7f99e80ad220 2024-08-17T02:28:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.010+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f99d8014620 con 0x7f99e80ad220 2024-08-17T02:28:05.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.011+0000 7f99dd600640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f99c4065150 0x7f99c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.011+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f99d8082d80 con 0x7f99e80ad220 2024-08-17T02:28:05.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.011+0000 7f99dfe00640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f99c4065150 0x7f99c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.012+0000 7f99dfe00640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f99c4065150 0x7f99c4067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99e814c3a0 tx=0x7f99d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.015+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f99d8050d50 con 0x7f99e80ad220 2024-08-17T02:28:05.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.241+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f99e8070720 con 0x7f99e80ad220 2024-08-17T02:28:05.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.828+0000 7f99dd600640 1 -- 172.21.15.42:0/1687385052 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f99d8009db0 con 0x7f99e80ad220 2024-08-17T02:28:05.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f99c4065150 msgr2=0x7f99c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f99c4065150 0x7f99c4067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99e814c3a0 tx=0x7f99d0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 msgr2=0x7f99e8144bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8144bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99d800d890 tx=0x7f99d8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 shutdown_connections 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f99c4065150 0x7f99c4067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99e814c9e0 0x7f99e8140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f99e80cc3d0 0x7f99e80afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 --2- 172.21.15.42:0/1687385052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e80ad220 0x7f99e8144bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 >> 172.21.15.42:0/1687385052 conn(0x7f99e8067930 msgr2=0x7f99e81465c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 shutdown_connections 2024-08-17T02:28:05.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:05.830+0000 7f99e7200640 1 -- 172.21.15.42:0/1687385052 wait complete. 2024-08-17T02:28:05.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:28:06.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.043+0000 7fe8c1000640 1 Processor -- start 2024-08-17T02:28:06.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.043+0000 7fe8c1000640 1 -- start start 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.044+0000 7fe8c1000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8bc161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.044+0000 7fe8c1000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc1582b0 con 0x7fe8bc156a90 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.044+0000 7fe8c1000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0ca110 con 0x7fe8bc0add70 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.044+0000 7fe8c1000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0c9f80 con 0x7fe8bc0aef00 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe8bc156a90 0x7fe8bc0ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35698/0 (socket says 172.21.15.42:35698) 2024-08-17T02:28:06.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9e00640 1 -- 172.21.15.42:0/2990108516 learned_addr learned my addr 172.21.15.42:0/2990108516 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8ba800640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8bc161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156278015 0 0) 0x7fe8bc1582b0 con 0x7fe8bc156a90 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a00034e0 con 0x7fe8bc156a90 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 366481688 0 0) 0x7fe8a00034e0 con 0x7fe8bc156a90 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 msgr2=0x7fe8bc161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8bc161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 >> v1:172.21.15.62:6789/0 conn(0x7fe8bc0add70 legacy=0x7fe8bc0ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.045+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0af4b0 con 0x7fe8bc156a90 2024-08-17T02:28:06.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fe8ac001470 con 0x7fe8bc156a90 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 >> v1:172.21.15.42:6789/0 conn(0x7fe8bc156a90 legacy=0x7fe8bc0ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a0003a00 0x7fe8a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8a0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a0004cc0 0x7fe8a0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0c9f80 con 0x7fe8a0003a00 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a000bb60 con 0x7fe8a0004cc0 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a000bcf0 con 0x7fe8bc0aef00 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a0003a00 0x7fe8a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8ba800640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a0004cc0 0x7fe8a0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b3e00640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8a0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9e00640 1 -- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 msgr2=0x7fe8a0004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8a0004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9e00640 1 -- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a0004cc0 msgr2=0x7fe8a0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a0004cc0 0x7fe8a0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b9e00640 1 -- 172.21.15.42:0/2990108516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00034e0 con 0x7fe8a0003a00 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8b3e00640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8bc0aef00 0x7fe8a0004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.046+0000 7fe8ba800640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8a0004cc0 0x7fe8a0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.047+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a0003a00 0x7fe8a0003e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c190 tx=0x7fe8ac001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f257bfd2f48a36b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac005890 con 0x7fe8a0003a00 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac02d070 con 0x7fe8a0003a00 2024-08-17T02:28:06.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8b9400640 1 -- 172.21.15.42:0/2990108516 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac005a50 con 0x7fe8a0003a00 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8c1000640 1 -- 172.21.15.42:0/2990108516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a0003a00 msgr2=0x7fe8a0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8c1000640 1 --2- 172.21.15.42:0/2990108516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8a0003a00 0x7fe8a0003e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c190 tx=0x7fe8ac001d80 comp rx=0 tx=0).stop 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8ba800640 1 -- 172.21.15.42:0/2990108516 reap_dead start 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8c1000640 1 -- 172.21.15.42:0/2990108516 shutdown_connections 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8c1000640 1 -- 172.21.15.42:0/2990108516 >> 172.21.15.42:0/2990108516 conn(0x7fe8bc066e60 msgr2=0x7fe8bc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8c1000640 1 -- 172.21.15.42:0/2990108516 shutdown_connections 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.048+0000 7fe8c1000640 1 -- 172.21.15.42:0/2990108516 wait complete. 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.050+0000 7fe8c1000640 1 Processor -- start 2024-08-17T02:28:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.050+0000 7fe8c1000640 1 -- start start 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8c1000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a0003a00 0x7fe8bc0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8c1000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8bc152620 0x7fe8bc0c0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8c1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 0x7fe8bc155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8c1000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0c0e50 con 0x7fe8bc155600 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8c1000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1693f0 con 0x7fe8bc152620 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8c1000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc16a3c0 con 0x7fe8a0003a00 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 0x7fe8bc155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 0x7fe8bc155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57532/0 (socket says 172.21.15.42:57532) 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 -- 172.21.15.42:0/1866630177 learned_addr learned my addr 172.21.15.42:0/1866630177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8b3e00640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8bc152620 0x7fe8bc0c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a0003a00 0x7fe8bc0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 -- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a0003a00 msgr2=0x7fe8bc0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a0003a00 0x7fe8bc0c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 -- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8bc152620 msgr2=0x7fe8bc0c0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8bc152620 0x7fe8bc0c0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8ba800640 1 -- 172.21.15.42:0/1866630177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc155fb0 con 0x7fe8bc155600 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8b3e00640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8bc152620 0x7fe8bc0c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.051+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a0003a00 0x7fe8bc0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.052+0000 7fe8ba800640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 0x7fe8bc155a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0004700 tx=0x7fe8b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.052+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b401b070 con 0x7fe8bc155600 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.052+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400f040 con 0x7fe8bc155600 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.052+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400e050 con 0x7fe8bc155600 2024-08-17T02:28:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.052+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc169f30 con 0x7fe8bc155600 2024-08-17T02:28:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.052+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc1698e0 con 0x7fe8bc155600 2024-08-17T02:28:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.053+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc063fb0 con 0x7fe8bc155600 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.054+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe8b4003020 con 0x7fe8bc155600 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.055+0000 7fe8b1600640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe898065150 0x7fe898067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.055+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe8b4082340 con 0x7fe8bc155600 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.055+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe898065150 0x7fe898067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.056+0000 7fe8b9e00640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe898065150 0x7fe898067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac032000 tx=0x7fe8ac033000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.059+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe8b40503d0 con 0x7fe8bc155600 2024-08-17T02:28:06.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.241+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8bc1573c0 con 0x7fe8bc155600 2024-08-17T02:28:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.834+0000 7fe8b1600640 1 -- 172.21.15.42:0/1866630177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe8b40539f0 con 0x7fe8bc155600 2024-08-17T02:28:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:28:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe898065150 msgr2=0x7fe898067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe898065150 0x7fe898067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac032000 tx=0x7fe8ac033000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 msgr2=0x7fe8bc155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 0x7fe8bc155a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0004700 tx=0x7fe8b400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 shutdown_connections 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe898065150 0x7fe898067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8bc155600 0x7fe8bc155a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe8bc152620 0x7fe8bc0c0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 --2- 172.21.15.42:0/1866630177 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8a0003a00 0x7fe8bc0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.838+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 >> 172.21.15.42:0/1866630177 conn(0x7fe8bc066e60 msgr2=0x7fe8bc153e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.839+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 shutdown_connections 2024-08-17T02:28:06.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:06.839+0000 7fe8c1000640 1 -- 172.21.15.42:0/1866630177 wait complete. 2024-08-17T02:28:06.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:28:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.015+0000 7fc1ca200640 1 Processor -- start 2024-08-17T02:28:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.015+0000 7fc1ca200640 1 -- start start 2024-08-17T02:28:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1ca200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc1c4158b00 0x7fc1c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1ca200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40b07f0 con 0x7fc1c4069d10 2024-08-17T02:28:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1ca200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40b0ad0 con 0x7fc1c40b1fa0 2024-08-17T02:28:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1ca200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40b0db0 con 0x7fc1c4158b00 2024-08-17T02:28:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1c3e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc1c4069d10 0x7fc1c40b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35706/0 (socket says 172.21.15.42:35706) 2024-08-17T02:28:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1c3e00640 1 -- 172.21.15.42:0/1044534461 learned_addr learned my addr 172.21.15.42:0/1044534461 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.016+0000 7fc1c8e00640 1 --2- 172.21.15.42:0/1044534461 >> v2:172.21.15.62:3300/0 conn(0x7fc1c4158b00 0x7fc1c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878891145 0 0) 0x7fc1c40b07f0 con 0x7fc1c4069d10 2024-08-17T02:28:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ac0034e0 con 0x7fc1c4069d10 2024-08-17T02:28:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60135935 0 0) 0x7fc1ac0034e0 con 0x7fc1c4069d10 2024-08-17T02:28:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 >> v2:172.21.15.62:3300/0 conn(0x7fc1c4158b00 msgr2=0x7fc1c40697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 --2- 172.21.15.42:0/1044534461 >> v2:172.21.15.62:3300/0 conn(0x7fc1c4158b00 0x7fc1c40697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 >> v1:172.21.15.62:6789/0 conn(0x7fc1c40b1fa0 legacy=0x7fc1c40ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40b1090 con 0x7fc1c4069d10 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fc1b0001470 con 0x7fc1c4069d10 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 >> v1:172.21.15.42:6789/0 conn(0x7fc1c4069d10 legacy=0x7fc1c40b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0039d0 0x7fc1ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac004780 0x7fc1ac004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ac005130 0x7fc1ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40b0db0 con 0x7fc1ac005130 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac00c040 con 0x7fc1ac0039d0 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac00c200 con 0x7fc1ac004780 2024-08-17T02:28:07.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ac005130 0x7fc1ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.017+0000 7fc1c8e00640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0039d0 0x7fc1ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.018+0000 7fc1c3e00640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac004780 0x7fc1ac004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.018+0000 7fc1c9800640 1 -- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac004780 msgr2=0x7fc1ac004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.018+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac004780 0x7fc1ac004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.018+0000 7fc1c9800640 1 -- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0039d0 msgr2=0x7fc1ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.018+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1ac0039d0 0x7fc1ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.018+0000 7fc1c9800640 1 -- 172.21.15.42:0/1044534461 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0034e0 con 0x7fc1ac005130 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1c9800640 1 -- 172.21.15.42:0/1044534461 reap_dead start 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ac005130 0x7fc1ac00b9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40b2370 tx=0x7fc1bc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6317554415621f8b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc02a8c0 con 0x7fc1ac005130 2024-08-17T02:28:07.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc02aa60 con 0x7fc1ac005130 2024-08-17T02:28:07.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1c3400640 1 -- 172.21.15.42:0/1044534461 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc02ae20 con 0x7fc1ac005130 2024-08-17T02:28:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1ca200640 1 -- 172.21.15.42:0/1044534461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ac005130 msgr2=0x7fc1ac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.019+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ac005130 0x7fc1ac00b9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40b2370 tx=0x7fc1bc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.020+0000 7fc1ca200640 1 -- 172.21.15.42:0/1044534461 shutdown_connections 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.020+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1044534461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1ac005130 0x7fc1ac00b9d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.020+0000 7fc1ca200640 1 -- 172.21.15.42:0/1044534461 >> 172.21.15.42:0/1044534461 conn(0x7fc1c4066e60 msgr2=0x7fc1c4067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.020+0000 7fc1ca200640 1 -- 172.21.15.42:0/1044534461 shutdown_connections 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.020+0000 7fc1ca200640 1 -- 172.21.15.42:0/1044534461 wait complete. 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.021+0000 7fc1ca200640 1 Processor -- start 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.021+0000 7fc1ca200640 1 -- start start 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1ca200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac005130 0x7fc1c4143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1ca200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c4095fe0 0x7fc1c415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1ca200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 0x7fc1c40cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1ca200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c415d6f0 con 0x7fc1c415c130 2024-08-17T02:28:07.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1ca200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c415cae0 con 0x7fc1c4095fe0 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1ca200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c415cdc0 con 0x7fc1ac005130 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1c9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 0x7fc1c40cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.022+0000 7fc1c9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 0x7fc1c40cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57546/0 (socket says 172.21.15.42:57546) 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 -- 172.21.15.42:0/1806263182 learned_addr learned my addr 172.21.15.42:0/1806263182 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c8e00640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac005130 0x7fc1c4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c3e00640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c4095fe0 0x7fc1c415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 -- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac005130 msgr2=0x7fc1c4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac005130 0x7fc1c4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 -- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c4095fe0 msgr2=0x7fc1c415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c4095fe0 0x7fc1c415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 -- 172.21.15.42:0/1806263182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c415d0a0 con 0x7fc1c415c130 2024-08-17T02:28:07.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1c9800640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 0x7fc1c40cc540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc001800 tx=0x7fc1bc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.023+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc03f070 con 0x7fc1c415c130 2024-08-17T02:28:07.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.024+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0074f0 con 0x7fc1c415c130 2024-08-17T02:28:07.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.024+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c415d380 con 0x7fc1c415c130 2024-08-17T02:28:07.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.024+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0069a0 con 0x7fc1c415c130 2024-08-17T02:28:07.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.024+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c40ccc20 con 0x7fc1c415c130 2024-08-17T02:28:07.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.025+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c415d8a0 con 0x7fc1c415c130 2024-08-17T02:28:07.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.026+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc1bc006d50 con 0x7fc1c415c130 2024-08-17T02:28:07.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.026+0000 7fc1b7e00640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1a4065180 0x7fc1a4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.027+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fc1bc0a1bb0 con 0x7fc1c415c130 2024-08-17T02:28:07.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.027+0000 7fc1c8e00640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1a4065180 0x7fc1a4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.027+0000 7fc1c8e00640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1a4065180 0x7fc1a4067630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80094d0 tx=0x7fc1b800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.031+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc1c415d8a0 con 0x7fc1c415c130 2024-08-17T02:28:07.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.217+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1c40ccc20 con 0x7fc1c415c130 2024-08-17T02:28:07.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.837+0000 7fc1b7e00640 1 -- 172.21.15.42:0/1806263182 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc1bc06fde0 con 0x7fc1c415c130 2024-08-17T02:28:07.837 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.840+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1a4065180 msgr2=0x7fc1a4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.840+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1a4065180 0x7fc1a4067630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80094d0 tx=0x7fc1b800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.840+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 msgr2=0x7fc1c40cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.840+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 0x7fc1c40cc540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc001800 tx=0x7fc1bc003000 comp rx=0 tx=0).stop 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 shutdown_connections 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1a4065180 0x7fc1a4067630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c415c130 0x7fc1c40cc540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc1c4095fe0 0x7fc1c415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 --2- 172.21.15.42:0/1806263182 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc1ac005130 0x7fc1c4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 >> 172.21.15.42:0/1806263182 conn(0x7fc1c4066e60 msgr2=0x7fc1c40afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 shutdown_connections 2024-08-17T02:28:07.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:07.841+0000 7fc1ca200640 1 -- 172.21.15.42:0/1806263182 wait complete. 2024-08-17T02:28:07.860 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:28:07.860 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:28:07.861 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:28:07.861 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:07.861 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:28:07.861 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:28:07.861 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:28:07.861 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:07.862 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:28:07.862 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:28:07.862 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:28:07.862 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:07.862 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:28:07.862 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:28:07.862 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:28:07.862 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:07.875 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:28:07.875 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:28:07.878 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:28:07.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:28:07.878 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:28:07.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:28:07.879 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:28:07.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:28:07.922 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:28:07.922 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:07.924 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:28:07.924 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:07.925 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:28:07.925 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:07.927 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:28:07.927 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:07.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:28:08.051 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-08-17T02:28:08.052 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-08-17T02:28:08.056 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-08-17T02:28:08.056 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-08-17T02:28:08.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.090+0000 7f343ca00640 1 Processor -- start 2024-08-17T02:28:08.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.091+0000 7f343ca00640 1 -- start start 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f343ca00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34380ad0b0 0x7f34380c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f343ca00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34380c92b0 con 0x7f34380acc60 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f343ca00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34380c8ca0 con 0x7f34380abdf0 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f343ca00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3438159ec0 con 0x7f34380ad0b0 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f342fe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f34380acc60 0x7f34380c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35726/0 (socket says 172.21.15.42:35726) 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f342fe00640 1 -- 172.21.15.42:0/2262115613 learned_addr learned my addr 172.21.15.42:0/2262115613 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:08.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f3436800640 1 --1- 172.21.15.42:0/2262115613 >> v1:172.21.15.62:6789/0 conn(0x7f34380abdf0 0x7f3438159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:49408/0 (socket says 172.21.15.42:49408) 2024-08-17T02:28:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.092+0000 7f3437200640 1 --2- 172.21.15.42:0/2262115613 >> v2:172.21.15.62:3300/0 conn(0x7f34380ad0b0 0x7f34380c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.093+0000 7f3437200640 1 -- 172.21.15.42:0/2262115613 >> v1:172.21.15.62:6789/0 conn(0x7f34380abdf0 legacy=0x7f3438159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.093+0000 7f3435e00640 1 -- 172.21.15.42:0/2262115613 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238203733 0 0) 0x7f34380c8ca0 con 0x7f34380abdf0 2024-08-17T02:28:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.093+0000 7f3437200640 1 -- 172.21.15.42:0/2262115613 >> v1:172.21.15.42:6789/0 conn(0x7f34380acc60 legacy=0x7f34380c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.093+0000 7f3437200640 1 -- 172.21.15.42:0/2262115613 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343815a1a0 con 0x7f34380ad0b0 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f3437200640 1 --2- 172.21.15.42:0/2262115613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f34380c9e50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3430009e60 tx=0x7f3430009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7be2a4ceca17184 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f3435e00640 1 -- 172.21.15.42:0/2262115613 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430007550 con 0x7f34380ad0b0 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f3435e00640 1 -- 172.21.15.42:0/2262115613 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343002d050 con 0x7f34380ad0b0 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f3435e00640 1 -- 172.21.15.42:0/2262115613 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300078e0 con 0x7f34380ad0b0 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f343ca00640 1 -- 172.21.15.42:0/2262115613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 msgr2=0x7f34380c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f343ca00640 1 --2- 172.21.15.42:0/2262115613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f34380c9e50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3430009e60 tx=0x7f3430009780 comp rx=0 tx=0).stop 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f343ca00640 1 -- 172.21.15.42:0/2262115613 shutdown_connections 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f343ca00640 1 --2- 172.21.15.42:0/2262115613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f34380c9e50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.094+0000 7f343ca00640 1 -- 172.21.15.42:0/2262115613 >> 172.21.15.42:0/2262115613 conn(0x7f3438066e60 msgr2=0x7f3438067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.095+0000 7f343ca00640 1 -- 172.21.15.42:0/2262115613 shutdown_connections 2024-08-17T02:28:08.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.095+0000 7f343ca00640 1 -- 172.21.15.42:0/2262115613 wait complete. 2024-08-17T02:28:08.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.096+0000 7f343ca00640 1 Processor -- start 2024-08-17T02:28:08.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.096+0000 7f343ca00640 1 -- start start 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f343ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 0x7f3438151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f343ca00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34380acc60 0x7f343814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f343ca00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f343814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f343ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438151660 con 0x7f34380abdf0 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f343ca00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438150a50 con 0x7f34380ad0b0 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f343ca00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3438150d30 con 0x7f34380acc60 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f3436800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 0x7f3438151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f3436800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 0x7f3438151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57572/0 (socket says 172.21.15.42:57572) 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f3436800640 1 -- 172.21.15.42:0/807316118 learned_addr learned my addr 172.21.15.42:0/807316118 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f3437200640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f343814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.097+0000 7f342fe00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34380acc60 0x7f343814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f3436800640 1 -- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34380acc60 msgr2=0x7f343814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f3436800640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34380acc60 0x7f343814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f3436800640 1 -- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 msgr2=0x7f343814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f3436800640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f343814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f3436800640 1 -- 172.21.15.42:0/807316118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009a20 con 0x7f34380abdf0 2024-08-17T02:28:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f3436800640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 0x7f3438151af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f342800c5e0 tx=0x7f3428007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428007300 con 0x7f34380abdf0 2024-08-17T02:28:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428007480 con 0x7f34380abdf0 2024-08-17T02:28:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280049f0 con 0x7f34380abdf0 2024-08-17T02:28:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3438151010 con 0x7f34380abdf0 2024-08-17T02:28:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.098+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343814d760 con 0x7f34380abdf0 2024-08-17T02:28:08.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.099+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3438070720 con 0x7f34380abdf0 2024-08-17T02:28:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.100+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f34280113a0 con 0x7f34380abdf0 2024-08-17T02:28:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.101+0000 7f342e000640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3414065150 0x7f3414067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.101+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3428081240 con 0x7f34380abdf0 2024-08-17T02:28:08.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.101+0000 7f342fe00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3414065150 0x7f3414067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.102+0000 7f342fe00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3414065150 0x7f3414067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f343806b470 tx=0x7f3420007e20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.105+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f342804f690 con 0x7f34380abdf0 2024-08-17T02:28:08.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.300+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3438067c80 con 0x7f34380abdf0 2024-08-17T02:28:08.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.854+0000 7f342e000640 1 -- 172.21.15.42:0/807316118 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3428052cb0 con 0x7f34380abdf0 2024-08-17T02:28:08.855 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3414065150 msgr2=0x7f3414067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3414065150 0x7f3414067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f343806b470 tx=0x7f3420007e20 comp rx=0 tx=0).stop 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 msgr2=0x7f3438151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 0x7f3438151af0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f342800c5e0 tx=0x7f3428007d00 comp rx=0 tx=0).stop 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 shutdown_connections 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3414065150 0x7f3414067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34380ad0b0 0x7f343814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34380acc60 0x7f343814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 --2- 172.21.15.42:0/807316118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34380abdf0 0x7f3438151af0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.857+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 >> 172.21.15.42:0/807316118 conn(0x7f3438066e60 msgr2=0x7f3438159400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.858+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 shutdown_connections 2024-08-17T02:28:08.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:08.858+0000 7f343ca00640 1 -- 172.21.15.42:0/807316118 wait complete. 2024-08-17T02:28:08.875 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:28:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.028+0000 7f9175c00640 1 Processor -- start 2024-08-17T02:28:09.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.029+0000 7f9175c00640 1 -- start start 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9175c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f91700adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9175c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91701552d0 0x7f9170155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9175c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91700cb180 con 0x7f91700ad790 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9175c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91700af530 con 0x7f91701552d0 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9175c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91700ca8e0 con 0x7f91700ca430 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9167e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f91700adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9167e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f91700adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:60474/0 (socket says 172.21.15.42:60474) 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.030+0000 7f9167e00640 1 -- 172.21.15.42:0/3634157201 learned_addr learned my addr 172.21.15.42:0/3634157201 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.031+0000 7f9175200640 1 --2- 172.21.15.42:0/3634157201 >> v2:172.21.15.62:3300/0 conn(0x7f91701552d0 0x7f9170155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.031+0000 7f9167e00640 1 -- 172.21.15.42:0/3634157201 >> v2:172.21.15.62:3300/0 conn(0x7f91701552d0 msgr2=0x7f9170155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.031+0000 7f9167e00640 1 --2- 172.21.15.42:0/3634157201 >> v2:172.21.15.62:3300/0 conn(0x7f91701552d0 0x7f9170155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.031+0000 7f9167e00640 1 -- 172.21.15.42:0/3634157201 >> v1:172.21.15.62:6789/0 conn(0x7f91700ad790 legacy=0x7f91700c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.031+0000 7f9167e00640 1 -- 172.21.15.42:0/3634157201 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700cabc0 con 0x7f91700ca430 2024-08-17T02:28:09.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.032+0000 7f9167e00640 1 --2- 172.21.15.42:0/3634157201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f91700adb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9158009910 tx=0x7f91580091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d01263a58e75897 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.032+0000 7f916f400640 1 -- 172.21.15.42:0/3634157201 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915802adb0 con 0x7f91700ca430 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.032+0000 7f916f400640 1 -- 172.21.15.42:0/3634157201 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9158032440 con 0x7f91700ca430 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f916f400640 1 -- 172.21.15.42:0/3634157201 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158032820 con 0x7f91700ca430 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 -- 172.21.15.42:0/3634157201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 msgr2=0x7f91700adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 --2- 172.21.15.42:0/3634157201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f91700adb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9158009910 tx=0x7f91580091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 -- 172.21.15.42:0/3634157201 shutdown_connections 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 --2- 172.21.15.42:0/3634157201 >> v2:172.21.15.62:3300/0 conn(0x7f91701552d0 0x7f9170155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 --2- 172.21.15.42:0/3634157201 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f91700adb60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 -- 172.21.15.42:0/3634157201 >> 172.21.15.42:0/3634157201 conn(0x7f9170062af0 msgr2=0x7f9170062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 -- 172.21.15.42:0/3634157201 shutdown_connections 2024-08-17T02:28:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.033+0000 7f9175c00640 1 -- 172.21.15.42:0/3634157201 wait complete. 2024-08-17T02:28:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.035+0000 7f9175c00640 1 Processor -- start 2024-08-17T02:28:09.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.035+0000 7f9175c00640 1 -- start start 2024-08-17T02:28:09.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 0x7f917013c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f917014f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91701552d0 0x7f917014f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91701532c0 con 0x7f91700ad790 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170152e30 con 0x7f91701552d0 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917013c680 con 0x7f91700ca430 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f916fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 0x7f917013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f916fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 0x7f917013c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57586/0 (socket says 172.21.15.42:57586) 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f916fe00640 1 -- 172.21.15.42:0/2215005392 learned_addr learned my addr 172.21.15.42:0/2215005392 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9167e00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f917014f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.036+0000 7f9175200640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91701552d0 0x7f917014f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f916fe00640 1 -- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 msgr2=0x7f917014f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f916fe00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f917014f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f916fe00640 1 -- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91701552d0 msgr2=0x7f917014f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f916fe00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91701552d0 0x7f917014f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f916fe00640 1 -- 172.21.15.42:0/2215005392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158009450 con 0x7f91700ad790 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f916fe00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 0x7f917013c140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f916000c560 tx=0x7f9160007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160011590 con 0x7f91700ad790 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160011710 con 0x7f91700ad790 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160011ad0 con 0x7f91700ad790 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9170152220 con 0x7f91700ad790 2024-08-17T02:28:09.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.037+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91701527e0 con 0x7f91700ad790 2024-08-17T02:28:09.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.038+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917015a2e0 con 0x7f91700ad790 2024-08-17T02:28:09.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.039+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f916001b3b0 con 0x7f91700ad790 2024-08-17T02:28:09.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.040+0000 7f9167400640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f914c065150 0x7f914c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.041+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9160081690 con 0x7f91700ad790 2024-08-17T02:28:09.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.041+0000 7f9167e00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f914c065150 0x7f914c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.041+0000 7f9167e00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f914c065150 0x7f914c067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9158034000 tx=0x7f9158032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.044+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f916004fab0 con 0x7f91700ad790 2024-08-17T02:28:09.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.290+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f91700aede0 con 0x7f91700ad790 2024-08-17T02:28:09.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.291+0000 7f9167400640 1 -- 172.21.15.42:0/2215005392 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f9160017020 con 0x7f91700ad790 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBOCsBmTNHCLRAAZWCcymcwTmLh7d+sbTs6Lg==", 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-08-17T02:28:09.292 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBPCsBmkwcmBRAAArpoavwprRIqvNsasL3UPQ==", 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.293 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBOCsBm5RJSNxAAKzpmsJO/A4cDRkTsAIJOcw==", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBPCsBm5vafDhAAYXu0lzXhyJtK2Nm43JiCOQ==", 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.294 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBQCsBmm7jaOhAAuNYlUk2B5eukzP/JWQFrNg==", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBUCsBmQgJIAhAA10/C9DkcmiCyASCIQrmhZA==", 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBXCsBm5eFnBhAApU29LKOHdL14PD0L2bhing==", 2024-08-17T02:28:09.296 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBaCsBmHb7UChAAfPwhKviTk09nYXy+t1fOUw==", 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBgCsBmI5OxAxAAGT8KGHjz9iBBmYoxKX7yUQ==", 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBjCsBmRpMxCBAAsW+4DMNa93INCAj84ntnaQ==", 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.298 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBmCsBmhGJ6CxAApmGjpDRGcE6SNh6E9ro/zw==", 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBpCsBmauCzDxAAfsASZsMvR+/r6D7LFZXyxw==", 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBPCsBmrPPBFhAAE9cXDJE9M8YaYoGLEerUGw==", 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.300 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBPCsBmvr/kIhAAGGyGmboL+4ssKORkdwzDBw==", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-08-17T02:28:09.301 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBPCsBmPtvXHBAAhb/CT/SPQo9RiJBqdFQf+A==", 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.302 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBPCsBmB6n4KBAAo3Z+O6mBlbuDxra06Ux/JQ==", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBNCsBmqo0NOxAAO/LD5rcRmVSfXL7cOHuY3w==", 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.303 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQB6CsBm7khPJBAAtEuygq8UNMXFoBvHFK9/FA==", 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:28:09.304 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQB6CsBmhlVPJBAAenXF6mAupV4mXR9MaAucKQ==", 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQB6CsBmnWJPJBAAZrXxGqP1WJsiGWdlJ8M65A==", 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQB6CsBmb2tPJBAAWBiInYTpmG8NFqCb3DlgTw==", 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQB6CsBmmntPJBAAjveNt2J4NNlqWPpsinZSiQ==", 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQB6CsBm4oRPJBAAG/wF+vnuIliou7Xb6r2Glw==", 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBOCsBmM+iCJxAAwCvDap8ssfkLqhUsFKKNjQ==", 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:09.307 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQBOCsBmqZPyIBAAy0vvidimLZn3HRtHNwac/g==", 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:09.308 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-08-17T02:28:09.309 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:28:09.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f914c065150 msgr2=0x7f914c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f914c065150 0x7f914c067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9158034000 tx=0x7f9158032000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 msgr2=0x7f917013c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 0x7f917013c140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f916000c560 tx=0x7f9160007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 shutdown_connections 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f914c065150 0x7f914c067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91701552d0 0x7f917014f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91700ca430 0x7f917014f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 --2- 172.21.15.42:0/2215005392 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91700ad790 0x7f917013c140 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 >> 172.21.15.42:0/2215005392 conn(0x7f9170062af0 msgr2=0x7f91700a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 shutdown_connections 2024-08-17T02:28:09.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.293+0000 7f9175c00640 1 -- 172.21.15.42:0/2215005392 wait complete. 2024-08-17T02:28:09.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:28:09.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.464+0000 7f1d54800640 1 Processor -- start 2024-08-17T02:28:09.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.464+0000 7f1d54800640 1 -- start start 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.465+0000 7f1d54800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0ca050 0x7f1d4c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.465+0000 7f1d54800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d4c0add30 0x7f1d4c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.465+0000 7f1d54800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c15b5e0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.465+0000 7f1d54800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0cb160 con 0x7f1d4c0add30 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.465+0000 7f1d54800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0b0d10 con 0x7f1d4c0ca050 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d4c0add30 0x7f1d4c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1d4c0add30 0x7f1d4c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57592/0 (socket says 172.21.15.42:57592) 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 -- 172.21.15.42:0/3250648512 learned_addr learned my addr 172.21.15.42:0/3250648512 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d51400640 1 --2- 172.21.15.42:0/3250648512 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0ca050 0x7f1d4c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 -- 172.21.15.42:0/3250648512 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0ca050 msgr2=0x7f1d4c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 --2- 172.21.15.42:0/3250648512 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0ca050 0x7f1d4c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 -- 172.21.15.42:0/3250648512 >> v1:172.21.15.62:6789/0 conn(0x7f1d4c0ad960 legacy=0x7f1d4c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.466+0000 7f1d52800640 1 -- 172.21.15.42:0/3250648512 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0ca550 con 0x7f1d4c0add30 2024-08-17T02:28:09.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.467+0000 7f1d52800640 1 --2- 172.21.15.42:0/3250648512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c063600 tx=0x7f1d48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a938c71cf8e560 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.467+0000 7f1d50a00640 1 -- 172.21.15.42:0/3250648512 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48032480 con 0x7f1d4c0add30 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.467+0000 7f1d50a00640 1 -- 172.21.15.42:0/3250648512 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d480325e0 con 0x7f1d4c0add30 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.467+0000 7f1d50a00640 1 -- 172.21.15.42:0/3250648512 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d480329c0 con 0x7f1d4c0add30 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 -- 172.21.15.42:0/3250648512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0add30 msgr2=0x7f1d4c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 --2- 172.21.15.42:0/3250648512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c063600 tx=0x7f1d48009840 comp rx=0 tx=0).stop 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 -- 172.21.15.42:0/3250648512 shutdown_connections 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 --2- 172.21.15.42:0/3250648512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 --2- 172.21.15.42:0/3250648512 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0ca050 0x7f1d4c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 -- 172.21.15.42:0/3250648512 >> 172.21.15.42:0/3250648512 conn(0x7f1d4c066e60 msgr2=0x7f1d4c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 -- 172.21.15.42:0/3250648512 shutdown_connections 2024-08-17T02:28:09.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.468+0000 7f1d54800640 1 -- 172.21.15.42:0/3250648512 wait complete. 2024-08-17T02:28:09.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.469+0000 7f1d54800640 1 Processor -- start 2024-08-17T02:28:09.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.469+0000 7f1d54800640 1 -- start start 2024-08-17T02:28:09.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.470+0000 7f1d54800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 0x7f1d4c13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.470+0000 7f1d54800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.470+0000 7f1d54800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0ca050 0x7f1d4c06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.470+0000 7f1d54800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c158bd0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.470+0000 7f1d54800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c157fc0 con 0x7f1d4c0add30 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.470+0000 7f1d54800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1582a0 con 0x7f1d4c0ca050 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 0x7f1d4c13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 0x7f1d4c13e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57604/0 (socket says 172.21.15.42:57604) 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 -- 172.21.15.42:0/1447599029 learned_addr learned my addr 172.21.15.42:0/1447599029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d52800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0ca050 0x7f1d4c06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51400640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 -- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0ca050 msgr2=0x7f1d4c06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0ca050 0x7f1d4c06dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 -- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c0add30 msgr2=0x7f1d4c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 -- 172.21.15.42:0/1447599029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48009ae0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d51e00640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 0x7f1d4c13e5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000c4c0 tx=0x7f1d40007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.471+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40011590 con 0x7f1d4c0ad960 2024-08-17T02:28:09.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.472+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d40011710 con 0x7f1d4c0ad960 2024-08-17T02:28:09.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.472+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40011ad0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.472+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c158580 con 0x7f1d4c0ad960 2024-08-17T02:28:09.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.472+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c157c70 con 0x7f1d4c0ad960 2024-08-17T02:28:09.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.473+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c063fb0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.473+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1d4001a360 con 0x7f1d4c0ad960 2024-08-17T02:28:09.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.474+0000 7f1d45600640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.474+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1d40081110 con 0x7f1d4c0ad960 2024-08-17T02:28:09.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.474+0000 7f1d51400640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.475+0000 7f1d51400640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c16bfb0 tx=0x7f1d3c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.478+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d4004f480 con 0x7f1d4c0ad960 2024-08-17T02:28:09.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.728+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1d4c15b5e0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.732+0000 7f1d45600640 1 -- 172.21.15.42:0/1447599029 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1d4c15b5e0 con 0x7f1d4c0ad960 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 msgr2=0x7f1d30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c16bfb0 tx=0x7f1d3c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 msgr2=0x7f1d4c13e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 0x7f1d4c13e5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000c4c0 tx=0x7f1d40007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 shutdown_connections 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1d30065150 0x7f1d30067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0ca050 0x7f1d4c06dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c0add30 0x7f1d4c15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 --2- 172.21.15.42:0/1447599029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1d4c0ad960 0x7f1d4c13e5d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.734+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 >> 172.21.15.42:0/1447599029 conn(0x7f1d4c066e60 msgr2=0x7f1d4c1561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.735+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 shutdown_connections 2024-08-17T02:28:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.735+0000 7f1d54800640 1 -- 172.21.15.42:0/1447599029 wait complete. 2024-08-17T02:28:09.750 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:28:09.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.906+0000 7f3fe9c00640 1 Processor -- start 2024-08-17T02:28:09.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.907+0000 7f3fe9c00640 1 -- start start 2024-08-17T02:28:09.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe40ae540 0x7f3fe4068950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3fe40af020 0x7f3fe4162730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40aab10 con 0x7f3fe4068e90 2024-08-17T02:28:09.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40abfb0 con 0x7f3fe40af020 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40ac250 con 0x7f3fe40ae540 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3fe40af020 0x7f3fe4162730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3fe40af020 0x7f3fe4162730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57616/0 (socket says 172.21.15.42:57616) 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe9200640 1 -- 172.21.15.42:0/2244670599 learned_addr learned my addr 172.21.15.42:0/2244670599 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.908+0000 7f3fe3e00640 1 --2- 172.21.15.42:0/2244670599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe40ae540 0x7f3fe4068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.909+0000 7f3fe9200640 1 -- 172.21.15.42:0/2244670599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe40ae540 msgr2=0x7f3fe4068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.909+0000 7f3fe9200640 1 --2- 172.21.15.42:0/2244670599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe40ae540 0x7f3fe4068950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.909+0000 7f3fe9200640 1 -- 172.21.15.42:0/2244670599 >> v1:172.21.15.62:6789/0 conn(0x7f3fe4068e90 legacy=0x7f3fe40ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.909+0000 7f3fe9200640 1 -- 172.21.15.42:0/2244670599 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40693e0 con 0x7f3fe40af020 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9200640 1 --2- 172.21.15.42:0/2244670599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40af020 0x7f3fe4162730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009f20 tx=0x7f3fdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6da3dea68c8a438 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe3400640 1 -- 172.21.15.42:0/2244670599 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc031400 con 0x7f3fe40af020 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe3400640 1 -- 172.21.15.42:0/2244670599 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc02d050 con 0x7f3fe40af020 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe3400640 1 -- 172.21.15.42:0/2244670599 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0317d0 con 0x7f3fe40af020 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2244670599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40af020 msgr2=0x7f3fe4162730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2244670599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40af020 0x7f3fe4162730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009f20 tx=0x7f3fdc009840 comp rx=0 tx=0).stop 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2244670599 shutdown_connections 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2244670599 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40af020 0x7f3fe4162730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2244670599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe40ae540 0x7f3fe4068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.910+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2244670599 >> 172.21.15.42:0/2244670599 conn(0x7f3fe40ce400 msgr2=0x7f3fe4095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.911+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2244670599 shutdown_connections 2024-08-17T02:28:09.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.911+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2244670599 wait complete. 2024-08-17T02:28:09.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.912+0000 7f3fe9c00640 1 Processor -- start 2024-08-17T02:28:09.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.912+0000 7f3fe9c00640 1 -- start start 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe4068e90 0x7f3fe40ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 0x7f3fe40cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe40af020 0x7f3fe4149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4099cd0 con 0x7f3fe40ae540 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40cce20 con 0x7f3fe40af020 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40cd100 con 0x7f3fe4068e90 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fdbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 0x7f3fe40cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fdbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 0x7f3fe40cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57618/0 (socket says 172.21.15.42:57618) 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe9200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe40af020 0x7f3fe4149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fdbe00640 1 -- 172.21.15.42:0/2483977041 learned_addr learned my addr 172.21.15.42:0/2483977041 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.913+0000 7f3fe3e00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe4068e90 0x7f3fe40ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdbe00640 1 -- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe4068e90 msgr2=0x7f3fe40ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdbe00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe4068e90 0x7f3fe40ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdbe00640 1 -- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe40af020 msgr2=0x7f3fe4149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdbe00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe40af020 0x7f3fe4149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdbe00640 1 -- 172.21.15.42:0/2483977041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009ae0 con 0x7f3fe40ae540 2024-08-17T02:28:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdbe00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 0x7f3fe40cc460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c4c0 tx=0x7f3fcc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011590 con 0x7f3fe40ae540 2024-08-17T02:28:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc011710 con 0x7f3fe40ae540 2024-08-17T02:28:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011ad0 con 0x7f3fe40ae540 2024-08-17T02:28:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40cd3e0 con 0x7f3fe40ae540 2024-08-17T02:28:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.914+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe40cabe0 con 0x7f3fe40ae540 2024-08-17T02:28:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.916+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe40cadd0 con 0x7f3fe40ae540 2024-08-17T02:28:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.916+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3fcc01b3b0 con 0x7f3fe40ae540 2024-08-17T02:28:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.917+0000 7f3fdb400640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3fc0065150 0x7f3fc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.917+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3fcc081510 con 0x7f3fe40ae540 2024-08-17T02:28:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.917+0000 7f3fe3e00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3fc0065150 0x7f3fc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.918+0000 7f3fe3e00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3fc0065150 0x7f3fc0067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009d20 tx=0x7f3fd40090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:09.921+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3fcc04f9d0 con 0x7f3fe40ae540 2024-08-17T02:28:10.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.174+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3fe4070720 con 0x7f3fe40ae540 2024-08-17T02:28:10.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.178+0000 7f3fdb400640 1 -- 172.21.15.42:0/2483977041 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3fcc017020 con 0x7f3fe40ae540 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3fc0065150 msgr2=0x7f3fc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3fc0065150 0x7f3fc0067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009d20 tx=0x7f3fd40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 msgr2=0x7f3fe40cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 0x7f3fe40cc460 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00c4c0 tx=0x7f3fcc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 shutdown_connections 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3fc0065150 0x7f3fc0067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3fe40af020 0x7f3fe4149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fe40ae540 0x7f3fe40cc460 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 --2- 172.21.15.42:0/2483977041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3fe4068e90 0x7f3fe40ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 >> 172.21.15.42:0/2483977041 conn(0x7f3fe40ce400 msgr2=0x7f3fe406cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 shutdown_connections 2024-08-17T02:28:10.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.180+0000 7f3fe9c00640 1 -- 172.21.15.42:0/2483977041 wait complete. 2024-08-17T02:28:10.196 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:28:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.347+0000 7f6703200640 1 Processor -- start 2024-08-17T02:28:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.348+0000 7f6703200640 1 -- start start 2024-08-17T02:28:10.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6703200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f6704159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6703200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67041599b0 0x7f67040acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6703200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67040c92b0 con 0x7f67040ad1a0 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6703200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67040ad640 con 0x7f67041599b0 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6703200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040c8ca0 con 0x7f67040abdf0 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f66f9400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f67041599b0 0x7f67040acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6702800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f67040ad1a0 0x7f670406d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35730/0 (socket says 172.21.15.42:35730) 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6702800640 1 -- 172.21.15.42:0/697791589 learned_addr learned my addr 172.21.15.42:0/697791589 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.349+0000 7f6701e00640 1 --2- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f6704159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.350+0000 7f66f9400640 1 -- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 msgr2=0x7f6704159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.350+0000 7f66f9400640 1 --2- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f6704159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.350+0000 7f66f9400640 1 -- 172.21.15.42:0/697791589 >> v1:172.21.15.42:6789/0 conn(0x7f67040ad1a0 legacy=0x7f670406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.350+0000 7f66f9400640 1 -- 172.21.15.42:0/697791589 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704159ec0 con 0x7f67041599b0 2024-08-17T02:28:10.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.350+0000 7f6701400640 1 -- 172.21.15.42:0/697791589 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726372933 0 0) 0x7f67040c92b0 con 0x7f67040ad1a0 2024-08-17T02:28:10.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.351+0000 7f66f9400640 1 --2- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67041599b0 0x7f67040acc60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009850 tx=0x7f66ec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5ac9eefd945bdb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.351+0000 7f6701400640 1 -- 172.21.15.42:0/697791589 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec02ad80 con 0x7f67041599b0 2024-08-17T02:28:10.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.351+0000 7f6701400640 1 -- 172.21.15.42:0/697791589 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec032440 con 0x7f67041599b0 2024-08-17T02:28:10.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.351+0000 7f6701400640 1 -- 172.21.15.42:0/697791589 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0327e0 con 0x7f67041599b0 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 -- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67041599b0 msgr2=0x7f67040acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 --2- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67041599b0 0x7f67040acc60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009850 tx=0x7f66ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 -- 172.21.15.42:0/697791589 shutdown_connections 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 --2- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67041599b0 0x7f67040acc60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 --2- 172.21.15.42:0/697791589 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f6704159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 -- 172.21.15.42:0/697791589 >> 172.21.15.42:0/697791589 conn(0x7f6704066e60 msgr2=0x7f6704067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 -- 172.21.15.42:0/697791589 shutdown_connections 2024-08-17T02:28:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.352+0000 7f6703200640 1 -- 172.21.15.42:0/697791589 wait complete. 2024-08-17T02:28:10.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.353+0000 7f6703200640 1 Processor -- start 2024-08-17T02:28:10.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 -- start start 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f670415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040ad1a0 0x7f670415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 0x7f670415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040aa100 con 0x7f67041599b0 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67040aa3a0 con 0x7f67040ad1a0 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.354+0000 7f6703200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67040aa680 con 0x7f67040abdf0 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 0x7f670415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 0x7f670415b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57634/0 (socket says 172.21.15.42:57634) 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 -- 172.21.15.42:0/1354807284 learned_addr learned my addr 172.21.15.42:0/1354807284 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6701e00640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f670415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f66f9400640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040ad1a0 0x7f670415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 -- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 msgr2=0x7f670415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f670415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 -- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040ad1a0 msgr2=0x7f670415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040ad1a0 0x7f670415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.355+0000 7f6702800640 1 -- 172.21.15.42:0/1354807284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec009390 con 0x7f67041599b0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.356+0000 7f6702800640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 0x7f670415b5d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00cc90 tx=0x7f66fc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.356+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00a850 con 0x7f67041599b0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.356+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc00a9b0 con 0x7f67041599b0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.356+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67040aa960 con 0x7f67041599b0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.356+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00ad70 con 0x7f67041599b0 2024-08-17T02:28:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.356+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6704140f30 con 0x7f67041599b0 2024-08-17T02:28:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.357+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67040ab160 con 0x7f67041599b0 2024-08-17T02:28:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.358+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66fc007300 con 0x7f67041599b0 2024-08-17T02:28:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.359+0000 7f66fa000640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f66e0065220 0x7f66e00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.359+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f66fc082270 con 0x7f67041599b0 2024-08-17T02:28:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.359+0000 7f6701e00640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f66e0065220 0x7f66e00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.360+0000 7f6701e00640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f66e0065220 0x7f66e00676d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009cb0 tx=0x7f66f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.363+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66fc0506e0 con 0x7f67041599b0 2024-08-17T02:28:10.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.613+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f67040aae60 con 0x7f67041599b0 2024-08-17T02:28:10.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.617+0000 7f66fa000640 1 -- 172.21.15.42:0/1354807284 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f66fc053d00 con 0x7f67041599b0 2024-08-17T02:28:10.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f66e0065220 msgr2=0x7f66e00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f66e0065220 0x7f66e00676d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009cb0 tx=0x7f66f4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 msgr2=0x7f670415b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 0x7f670415b5d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00cc90 tx=0x7f66fc001a80 comp rx=0 tx=0).stop 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 shutdown_connections 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f66e0065220 0x7f66e00676d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67041599b0 0x7f670415b5d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f67040ad1a0 0x7f670415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 --2- 172.21.15.42:0/1354807284 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f67040abdf0 0x7f670415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 >> 172.21.15.42:0/1354807284 conn(0x7f6704066e60 msgr2=0x7f67040ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 shutdown_connections 2024-08-17T02:28:10.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.619+0000 7f6703200640 1 -- 172.21.15.42:0/1354807284 wait complete. 2024-08-17T02:28:10.635 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:28:10.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.787+0000 7fb553800640 1 Processor -- start 2024-08-17T02:28:10.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.787+0000 7fb553800640 1 -- start start 2024-08-17T02:28:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.788+0000 7fb553800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb54c0afca0 0x7fb54c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.788+0000 7fb553800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0acf10 0x7fb54c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb553800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c15a4e0 con 0x7fb54c1589a0 2024-08-17T02:28:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb553800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0b0980 con 0x7fb54c0afca0 2024-08-17T02:28:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb553800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0c92b0 con 0x7fb54c0acf10 2024-08-17T02:28:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb551800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb54c1589a0 0x7fb54c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:35746/0 (socket says 172.21.15.42:35746) 2024-08-17T02:28:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb550e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb54c0afca0 0x7fb54c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb551800640 1 -- 172.21.15.42:0/3731700370 learned_addr learned my addr 172.21.15.42:0/3731700370 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb54be00640 1 --2- 172.21.15.42:0/3731700370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0acf10 0x7fb54c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb550e00640 1 -- 172.21.15.42:0/3731700370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0acf10 msgr2=0x7fb54c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb550e00640 1 --2- 172.21.15.42:0/3731700370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0acf10 0x7fb54c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb550e00640 1 -- 172.21.15.42:0/3731700370 >> v1:172.21.15.42:6789/0 conn(0x7fb54c1589a0 legacy=0x7fb54c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb550e00640 1 -- 172.21.15.42:0/3731700370 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0ad480 con 0x7fb54c0afca0 2024-08-17T02:28:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.789+0000 7fb54b400640 1 -- 172.21.15.42:0/3731700370 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139021341 0 0) 0x7fb544001490 con 0x7fb54c1589a0 2024-08-17T02:28:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.790+0000 7fb550e00640 1 --2- 172.21.15.42:0/3731700370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0afca0 0x7fb54c0b0070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb540009880 tx=0x7fb5400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c173f5e84281878 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb54b400640 1 -- 172.21.15.42:0/3731700370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54002ad70 con 0x7fb54c0afca0 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb54b400640 1 -- 172.21.15.42:0/3731700370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb540032440 con 0x7fb54c0afca0 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb54b400640 1 -- 172.21.15.42:0/3731700370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5400327e0 con 0x7fb54c0afca0 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 -- 172.21.15.42:0/3731700370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0afca0 msgr2=0x7fb54c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 --2- 172.21.15.42:0/3731700370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0afca0 0x7fb54c0b0070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb540009880 tx=0x7fb5400090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 -- 172.21.15.42:0/3731700370 shutdown_connections 2024-08-17T02:28:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 --2- 172.21.15.42:0/3731700370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0acf10 0x7fb54c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 --2- 172.21.15.42:0/3731700370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0afca0 0x7fb54c0b0070 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 -- 172.21.15.42:0/3731700370 >> 172.21.15.42:0/3731700370 conn(0x7fb54c066e60 msgr2=0x7fb54c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.791+0000 7fb553800640 1 -- 172.21.15.42:0/3731700370 shutdown_connections 2024-08-17T02:28:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.792+0000 7fb553800640 1 -- 172.21.15.42:0/3731700370 wait complete. 2024-08-17T02:28:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.793+0000 7fb553800640 1 Processor -- start 2024-08-17T02:28:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.793+0000 7fb553800640 1 -- start start 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb553800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 0x7fb54c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb553800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0afca0 0x7fb54c0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb553800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54c1589a0 0x7fb54c0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb553800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0c75f0 con 0x7fb54c0acf10 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb553800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c155f20 con 0x7fb54c1589a0 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb553800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c153c70 con 0x7fb54c0afca0 2024-08-17T02:28:10.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb550e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 0x7fb54c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb550e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 0x7fb54c153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57640/0 (socket says 172.21.15.42:57640) 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb550e00640 1 -- 172.21.15.42:0/1783915092 learned_addr learned my addr 172.21.15.42:0/1783915092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb54be00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0afca0 0x7fb54c0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.794+0000 7fb551800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54c1589a0 0x7fb54c0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb550e00640 1 -- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0afca0 msgr2=0x7fb54c0c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb550e00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0afca0 0x7fb54c0c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb550e00640 1 -- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54c1589a0 msgr2=0x7fb54c0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb550e00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54c1589a0 0x7fb54c0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb550e00640 1 -- 172.21.15.42:0/1783915092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540009390 con 0x7fb54c0acf10 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb54be00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0afca0 0x7fb54c0c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb551800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54c1589a0 0x7fb54c0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb550e00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 0x7fb54c153730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb540009360 tx=0x7fb540032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540000d10 con 0x7fb54c0acf10 2024-08-17T02:28:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb540031e00 con 0x7fb54c0acf10 2024-08-17T02:28:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c15cab0 con 0x7fb54c0acf10 2024-08-17T02:28:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54003d670 con 0x7fb54c0acf10 2024-08-17T02:28:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.795+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c0c6e00 con 0x7fb54c0acf10 2024-08-17T02:28:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.797+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c063fb0 con 0x7fb54c0acf10 2024-08-17T02:28:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.797+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb540039040 con 0x7fb54c0acf10 2024-08-17T02:28:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.798+0000 7fb53fe00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb52c065150 0x7fb52c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.798+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb5400a23a0 con 0x7fb54c0acf10 2024-08-17T02:28:10.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.798+0000 7fb54be00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb52c065150 0x7fb52c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.799+0000 7fb54be00640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb52c065150 0x7fb52c067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb54c06b540 tx=0x7fb538008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:10.802+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb540070710 con 0x7fb54c0acf10 2024-08-17T02:28:11.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.049+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb54c0cb010 con 0x7fb54c0acf10 2024-08-17T02:28:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.052+0000 7fb53fe00640 1 -- 172.21.15.42:0/1783915092 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb540073d30 con 0x7fb54c0acf10 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.054+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb52c065150 msgr2=0x7fb52c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.054+0000 7fb553800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb52c065150 0x7fb52c067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb54c06b540 tx=0x7fb538008040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 msgr2=0x7fb54c153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 0x7fb54c153730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb540009360 tx=0x7fb540032000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 shutdown_connections 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb52c065150 0x7fb52c067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb54c1589a0 0x7fb54c0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb54c0afca0 0x7fb54c0c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 --2- 172.21.15.42:0/1783915092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb54c0acf10 0x7fb54c153730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 >> 172.21.15.42:0/1783915092 conn(0x7fb54c066e60 msgr2=0x7fb54c06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 shutdown_connections 2024-08-17T02:28:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.055+0000 7fb553800640 1 -- 172.21.15.42:0/1783915092 wait complete. 2024-08-17T02:28:11.069 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:28:11.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.224+0000 7f65e3e00640 1 Processor -- start 2024-08-17T02:28:11.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.224+0000 7f65e3e00640 1 -- start start 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.225+0000 7f65e3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65e4158a00 0x7f65e4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.225+0000 7f65e3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.225+0000 7f65e3e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40cbc50 con 0x7f65e406e590 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.225+0000 7f65e3e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e40cbf30 con 0x7f65e4158a00 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.225+0000 7f65e3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40cc210 con 0x7f65e40cb190 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.225+0000 7f65e2a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65e4158a00 0x7f65e4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f65e4158a00 0x7f65e4158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33820/0 (socket says 172.21.15.42:33820) 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2a00640 1 -- 172.21.15.42:0/1294338442 learned_addr learned my addr 172.21.15.42:0/1294338442 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2000640 1 --2- 172.21.15.42:0/1294338442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2a00640 1 -- 172.21.15.42:0/1294338442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 msgr2=0x7f65e40cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2a00640 1 --2- 172.21.15.42:0/1294338442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2a00640 1 -- 172.21.15.42:0/1294338442 >> v1:172.21.15.62:6789/0 conn(0x7f65e406e590 legacy=0x7f65e40683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.226+0000 7f65e2a00640 1 -- 172.21.15.42:0/1294338442 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40b2930 con 0x7f65e4158a00 2024-08-17T02:28:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.227+0000 7f65e2a00640 1 --2- 172.21.15.42:0/1294338442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e4158a00 0x7f65e4158dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009910 tx=0x7f65d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b21d9e0aa513a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.227+0000 7f65e1600640 1 -- 172.21.15.42:0/1294338442 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d402ae40 con 0x7f65e4158a00 2024-08-17T02:28:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.227+0000 7f65e1600640 1 -- 172.21.15.42:0/1294338442 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d4032440 con 0x7f65e4158a00 2024-08-17T02:28:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.227+0000 7f65e1600640 1 -- 172.21.15.42:0/1294338442 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4032820 con 0x7f65e4158a00 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 -- 172.21.15.42:0/1294338442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e4158a00 msgr2=0x7f65e4158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 --2- 172.21.15.42:0/1294338442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e4158a00 0x7f65e4158dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009910 tx=0x7f65d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 -- 172.21.15.42:0/1294338442 shutdown_connections 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 --2- 172.21.15.42:0/1294338442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 --2- 172.21.15.42:0/1294338442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e4158a00 0x7f65e4158dd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 -- 172.21.15.42:0/1294338442 >> 172.21.15.42:0/1294338442 conn(0x7f65e40cfb80 msgr2=0x7f65e40cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 -- 172.21.15.42:0/1294338442 shutdown_connections 2024-08-17T02:28:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.228+0000 7f65e3e00640 1 -- 172.21.15.42:0/1294338442 wait complete. 2024-08-17T02:28:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.229+0000 7f65e3e00640 1 Processor -- start 2024-08-17T02:28:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.229+0000 7f65e3e00640 1 -- start start 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 0x7f65e4169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65e4158a00 0x7f65e40a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40a72a0 con 0x7f65e406e590 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4169860 con 0x7f65e4158a00 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40a6690 con 0x7f65e40cb190 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.230+0000 7f65e2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 0x7f65e4169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 0x7f65e4169320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33828/0 (socket says 172.21.15.42:33828) 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 -- 172.21.15.42:0/2496981241 learned_addr learned my addr 172.21.15.42:0/2496981241 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2000640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e3400640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65e4158a00 0x7f65e40a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 -- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 msgr2=0x7f65e40c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 -- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65e4158a00 msgr2=0x7f65e40a86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65e4158a00 0x7f65e40a86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 -- 172.21.15.42:0/2496981241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4009450 con 0x7f65e406e590 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e3400640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65e4158a00 0x7f65e40a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2000640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e2a00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 0x7f65e4169320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009970 tx=0x7f65d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4031c80 con 0x7f65e406e590 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d4031e00 con 0x7f65e406e590 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.231+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e40a6970 con 0x7f65e406e590 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.232+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d403d670 con 0x7f65e406e590 2024-08-17T02:28:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.232+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e40a6f30 con 0x7f65e406e590 2024-08-17T02:28:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.233+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4070720 con 0x7f65e406e590 2024-08-17T02:28:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.233+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f65d4039040 con 0x7f65e406e590 2024-08-17T02:28:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.234+0000 7f65da000640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f65c4065150 0x7f65c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.234+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f65d402ae40 con 0x7f65e406e590 2024-08-17T02:28:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.234+0000 7f65e2000640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f65c4065150 0x7f65c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.235+0000 7f65e2000640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f65c4065150 0x7f65c4067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65e40c9d10 tx=0x7f65d0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.238+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65d40707a0 con 0x7f65e406e590 2024-08-17T02:28:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.487+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f65e4067420 con 0x7f65e406e590 2024-08-17T02:28:11.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.491+0000 7f65da000640 1 -- 172.21.15.42:0/2496981241 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65d4073dc0 con 0x7f65e406e590 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f65c4065150 msgr2=0x7f65c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f65c4065150 0x7f65c4067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f65e40c9d10 tx=0x7f65d0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 msgr2=0x7f65e4169320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 0x7f65e4169320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009970 tx=0x7f65d4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 shutdown_connections 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f65c4065150 0x7f65c4067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65e4158a00 0x7f65e40a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65e40cb190 0x7f65e40c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 --2- 172.21.15.42:0/2496981241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65e406e590 0x7f65e4169320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.493+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 >> 172.21.15.42:0/2496981241 conn(0x7f65e40cfb80 msgr2=0x7f65e406e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.494+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 shutdown_connections 2024-08-17T02:28:11.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.494+0000 7f65e3e00640 1 -- 172.21.15.42:0/2496981241 wait complete. 2024-08-17T02:28:11.509 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:28:11.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.661+0000 7fd007e00640 1 Processor -- start 2024-08-17T02:28:11.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.661+0000 7fd007e00640 1 -- start start 2024-08-17T02:28:11.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd008158a00 0x7fd008158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0080cbc50 con 0x7fd00806e590 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0080cbf30 con 0x7fd008158a00 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080cc210 con 0x7fd0080cb190 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd006a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd008158a00 0x7fd008158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd00806e590 0x7fd0080683e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43740/0 (socket says 172.21.15.42:43740) 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.662+0000 7fd007400640 1 -- 172.21.15.42:0/3356742884 learned_addr learned my addr 172.21.15.42:0/3356742884 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.663+0000 7fd006000640 1 --2- 172.21.15.42:0/3356742884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.663+0000 7fd006a00640 1 -- 172.21.15.42:0/3356742884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 msgr2=0x7fd0080cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.663+0000 7fd006a00640 1 --2- 172.21.15.42:0/3356742884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.663+0000 7fd006a00640 1 -- 172.21.15.42:0/3356742884 >> v1:172.21.15.42:6789/0 conn(0x7fd00806e590 legacy=0x7fd0080683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.663+0000 7fd006a00640 1 -- 172.21.15.42:0/3356742884 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0080b2930 con 0x7fd008158a00 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.664+0000 7fd006a00640 1 --2- 172.21.15.42:0/3356742884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd008158dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009850 tx=0x7fcff80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05e9e7f6677d175 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.664+0000 7fd005600640 1 -- 172.21.15.42:0/3356742884 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff802ad90 con 0x7fd008158a00 2024-08-17T02:28:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.664+0000 7fd005600640 1 -- 172.21.15.42:0/3356742884 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8032440 con 0x7fd008158a00 2024-08-17T02:28:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.664+0000 7fd005600640 1 -- 172.21.15.42:0/3356742884 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8032820 con 0x7fd008158a00 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.664+0000 7fd007e00640 1 -- 172.21.15.42:0/3356742884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 msgr2=0x7fd008158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.664+0000 7fd007e00640 1 --2- 172.21.15.42:0/3356742884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd008158dd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009850 tx=0x7fcff80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.665+0000 7fd007e00640 1 -- 172.21.15.42:0/3356742884 shutdown_connections 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.665+0000 7fd007e00640 1 --2- 172.21.15.42:0/3356742884 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.665+0000 7fd007e00640 1 --2- 172.21.15.42:0/3356742884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd008158dd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.665+0000 7fd007e00640 1 -- 172.21.15.42:0/3356742884 >> 172.21.15.42:0/3356742884 conn(0x7fd0080cfb80 msgr2=0x7fd0080cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.665+0000 7fd007e00640 1 -- 172.21.15.42:0/3356742884 shutdown_connections 2024-08-17T02:28:11.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.665+0000 7fd007e00640 1 -- 172.21.15.42:0/3356742884 wait complete. 2024-08-17T02:28:11.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.666+0000 7fd007e00640 1 Processor -- start 2024-08-17T02:28:11.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.666+0000 7fd007e00640 1 -- start start 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd00806e590 0x7fd008169320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd0080a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080a72a0 con 0x7fd008158a00 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd008169860 con 0x7fd00806e590 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0080a6690 con 0x7fd0080cb190 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd0080a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd0080a86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33844/0 (socket says 172.21.15.42:33844) 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd007400640 1 -- 172.21.15.42:0/217900426 learned_addr learned my addr 172.21.15.42:0/217900426 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd006000640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.667+0000 7fd006a00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd00806e590 0x7fd008169320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fd007400640 1 -- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 msgr2=0x7fd0080c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fd007400640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fd007400640 1 -- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd00806e590 msgr2=0x7fd008169320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fd007400640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd00806e590 0x7fd008169320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fd007400640 1 -- 172.21.15.42:0/217900426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8009390 con 0x7fd008158a00 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fd007400640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd0080a86d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd00000cc70 tx=0x7fd000001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.668+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000ce90 con 0x7fd008158a00 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.669+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000a850 con 0x7fd008158a00 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.669+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000ac10 con 0x7fd008158a00 2024-08-17T02:28:11.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.669+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0080a6970 con 0x7fd008158a00 2024-08-17T02:28:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.669+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0080a6f30 con 0x7fd008158a00 2024-08-17T02:28:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.670+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0080a7450 con 0x7fd008158a00 2024-08-17T02:28:11.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.671+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd000007300 con 0x7fd008158a00 2024-08-17T02:28:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.671+0000 7fcffe000640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcfe8065150 0x7fcfe8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.671+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd000082170 con 0x7fd008158a00 2024-08-17T02:28:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.672+0000 7fd006a00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcfe8065150 0x7fcfe8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.672+0000 7fd006a00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcfe8065150 0x7fcfe8067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcff8034000 tx=0x7fcff8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.676+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd0080a7450 con 0x7fd008158a00 2024-08-17T02:28:11.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.930+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd0080a7450 con 0x7fd008158a00 2024-08-17T02:28:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.933+0000 7fcffe000640 1 -- 172.21.15.42:0/217900426 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd0080a7450 con 0x7fd008158a00 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcfe8065150 msgr2=0x7fcfe8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcfe8065150 0x7fcfe8067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcff8034000 tx=0x7fcff8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 msgr2=0x7fd0080a86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd0080a86d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd00000cc70 tx=0x7fd000001a50 comp rx=0 tx=0).stop 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 shutdown_connections 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcfe8065150 0x7fcfe8067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd008158a00 0x7fd0080a86d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0080cb190 0x7fd0080c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 --2- 172.21.15.42:0/217900426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd00806e590 0x7fd008169320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 >> 172.21.15.42:0/217900426 conn(0x7fd0080cfb80 msgr2=0x7fd00806e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 shutdown_connections 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:11.936+0000 7fd007e00640 1 -- 172.21.15.42:0/217900426 wait complete. 2024-08-17T02:28:11.951 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:12.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.102+0000 7f8c67200640 1 Processor -- start 2024-08-17T02:28:12.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.102+0000 7f8c67200640 1 -- start start 2024-08-17T02:28:12.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.103+0000 7f8c67200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c600ad960 0x7f8c6015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.103+0000 7f8c67200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.103+0000 7f8c67200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6015b5e0 con 0x7f8c600ca050 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.103+0000 7f8c67200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c600cb160 con 0x7f8c600ad960 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.103+0000 7f8c67200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600b0d10 con 0x7f8c600add30 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5fe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c600ad960 0x7f8c6015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5f400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c600ca050 0x7f8c60156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43746/0 (socket says 172.21.15.42:43746) 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5f400640 1 -- 172.21.15.42:0/2840905925 learned_addr learned my addr 172.21.15.42:0/2840905925 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c65200640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5fe00640 1 -- 172.21.15.42:0/2840905925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 msgr2=0x7f8c60156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5fe00640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5fe00640 1 -- 172.21.15.42:0/2840905925 >> v1:172.21.15.42:6789/0 conn(0x7f8c600ca050 legacy=0x7f8c60156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c5fe00640 1 -- 172.21.15.42:0/2840905925 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600ca550 con 0x7f8c600ad960 2024-08-17T02:28:12.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.104+0000 7f8c65200640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.105+0000 7f8c5fe00640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ad960 0x7f8c6015b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009850 tx=0x7f8c500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67b37fa2d46dad1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.105+0000 7f8c5ea00640 1 -- 172.21.15.42:0/2840905925 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5002ae20 con 0x7f8c600ad960 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.105+0000 7f8c5ea00640 1 -- 172.21.15.42:0/2840905925 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c50032440 con 0x7f8c600ad960 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.105+0000 7f8c5ea00640 1 -- 172.21.15.42:0/2840905925 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50032820 con 0x7f8c600ad960 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 -- 172.21.15.42:0/2840905925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ad960 msgr2=0x7f8c6015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ad960 0x7f8c6015b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009850 tx=0x7f8c500090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 -- 172.21.15.42:0/2840905925 shutdown_connections 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 --2- 172.21.15.42:0/2840905925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ad960 0x7f8c6015b0a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 -- 172.21.15.42:0/2840905925 >> 172.21.15.42:0/2840905925 conn(0x7f8c60066e60 msgr2=0x7f8c60067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 -- 172.21.15.42:0/2840905925 shutdown_connections 2024-08-17T02:28:12.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.106+0000 7f8c67200640 1 -- 172.21.15.42:0/2840905925 wait complete. 2024-08-17T02:28:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.107+0000 7f8c67200640 1 Processor -- start 2024-08-17T02:28:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 -- start start 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c600ad960 0x7f8c600a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 0x7f8c60167360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60166e80 con 0x7f8c600ca050 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6016a890 con 0x7f8c600ad960 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.108+0000 7f8c67200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6016ab70 con 0x7f8c600add30 2024-08-17T02:28:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 0x7f8c60167360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 0x7f8c60167360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33860/0 (socket says 172.21.15.42:33860) 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 -- 172.21.15.42:0/2324524000 learned_addr learned my addr 172.21.15.42:0/2324524000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c5fe00640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c600ad960 0x7f8c600a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c5f400640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 -- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 msgr2=0x7f8c60154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 -- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c600ad960 msgr2=0x7f8c600a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c600ad960 0x7f8c600a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 -- 172.21.15.42:0/2324524000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50009390 con 0x7f8c600ca050 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c5fe00640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c600ad960 0x7f8c600a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.109+0000 7f8c65200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 0x7f8c60167360 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800a380 tx=0x7f8c58007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.110+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800d650 con 0x7f8c600ca050 2024-08-17T02:28:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.110+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5800d7b0 con 0x7f8c600ca050 2024-08-17T02:28:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.110+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800db70 con 0x7f8c600ca050 2024-08-17T02:28:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.110+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6016ae50 con 0x7f8c600ca050 2024-08-17T02:28:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.110+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6015a2d0 con 0x7f8c600ca050 2024-08-17T02:28:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.111+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60063fb0 con 0x7f8c600ca050 2024-08-17T02:28:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.112+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8c5801e3b0 con 0x7f8c600ca050 2024-08-17T02:28:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.113+0000 7f8c57400640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c40065220 0x7f8c400676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.113+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8c58082c10 con 0x7f8c600ca050 2024-08-17T02:28:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.113+0000 7f8c5fe00640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c40065220 0x7f8c400676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.114+0000 7f8c5fe00640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c40065220 0x7f8c400676d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c50034000 tx=0x7f8c50032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.117+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8c58051000 con 0x7f8c600ca050 2024-08-17T02:28:12.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.304+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c60152160 con 0x7f8c600ca050 2024-08-17T02:28:12.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.305+0000 7f8c57400640 1 -- 172.21.15.42:0/2324524000 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f8c5801a090 con 0x7f8c600ca050 2024-08-17T02:28:12.305 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:12.305 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:08.860921+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c40065220 msgr2=0x7f8c400676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c40065220 0x7f8c400676d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c50034000 tx=0x7f8c50032000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 msgr2=0x7f8c60167360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 0x7f8c60167360 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800a380 tx=0x7f8c58007900 comp rx=0 tx=0).stop 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 shutdown_connections 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c40065220 0x7f8c400676d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c600ca050 0x7f8c60167360 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c600add30 0x7f8c60154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 --2- 172.21.15.42:0/2324524000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c600ad960 0x7f8c600a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 >> 172.21.15.42:0/2324524000 conn(0x7f8c60066e60 msgr2=0x7f8c60152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 shutdown_connections 2024-08-17T02:28:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.307+0000 7f8c67200640 1 -- 172.21.15.42:0/2324524000 wait complete. 2024-08-17T02:28:12.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:28:12.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:12.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.477+0000 7fe4a3000640 1 Processor -- start 2024-08-17T02:28:12.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.477+0000 7fe4a3000640 1 -- start start 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.478+0000 7fe4a3000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe49c158e60 0x7fe49c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.478+0000 7fe4a3000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe49c0ae860 0x7fe49c0ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.478+0000 7fe4a3000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0ad8a0 con 0x7fe49c0b03b0 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.478+0000 7fe4a3000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c06edf0 con 0x7fe49c158e60 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.478+0000 7fe4a3000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0acc90 con 0x7fe49c0ae860 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.478+0000 7fe49be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe49c158e60 0x7fe49c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe4a1000640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe49c0b03b0 0x7fe49c0b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43760/0 (socket says 172.21.15.42:43760) 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe4a1000640 1 -- 172.21.15.42:0/4252034901 learned_addr learned my addr 172.21.15.42:0/4252034901 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:12.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe49b400640 1 --2- 172.21.15.42:0/4252034901 >> v2:172.21.15.62:3300/0 conn(0x7fe49c0ae860 0x7fe49c0ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe49be00640 1 -- 172.21.15.42:0/4252034901 >> v2:172.21.15.62:3300/0 conn(0x7fe49c0ae860 msgr2=0x7fe49c0ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe49be00640 1 --2- 172.21.15.42:0/4252034901 >> v2:172.21.15.62:3300/0 conn(0x7fe49c0ae860 0x7fe49c0ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe49be00640 1 -- 172.21.15.42:0/4252034901 >> v1:172.21.15.42:6789/0 conn(0x7fe49c0b03b0 legacy=0x7fe49c0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.479+0000 7fe49be00640 1 -- 172.21.15.42:0/4252034901 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0acf70 con 0x7fe49c158e60 2024-08-17T02:28:12.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.480+0000 7fe49be00640 1 --2- 172.21.15.42:0/4252034901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0add30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0b00b0 tx=0x7fe48c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3119ec2478f94b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.480+0000 7fe49aa00640 1 -- 172.21.15.42:0/4252034901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c02adb0 con 0x7fe49c158e60 2024-08-17T02:28:12.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.480+0000 7fe49aa00640 1 -- 172.21.15.42:0/4252034901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c032440 con 0x7fe49c158e60 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.480+0000 7fe49aa00640 1 -- 172.21.15.42:0/4252034901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c032820 con 0x7fe49c158e60 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 -- 172.21.15.42:0/4252034901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 msgr2=0x7fe49c0add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 --2- 172.21.15.42:0/4252034901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0add30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0b00b0 tx=0x7fe48c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 -- 172.21.15.42:0/4252034901 shutdown_connections 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 --2- 172.21.15.42:0/4252034901 >> v2:172.21.15.62:3300/0 conn(0x7fe49c0ae860 0x7fe49c0ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 --2- 172.21.15.42:0/4252034901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0add30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 -- 172.21.15.42:0/4252034901 >> 172.21.15.42:0/4252034901 conn(0x7fe49c0cc390 msgr2=0x7fe49c066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 -- 172.21.15.42:0/4252034901 shutdown_connections 2024-08-17T02:28:12.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.481+0000 7fe4a3000640 1 -- 172.21.15.42:0/4252034901 wait complete. 2024-08-17T02:28:12.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.482+0000 7fe4a3000640 1 Processor -- start 2024-08-17T02:28:12.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 -- start start 2024-08-17T02:28:12.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe49c0ae860 0x7fe49c169180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe49c0b03b0 0x7fe49c0af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15c5e0 con 0x7fe49c158e60 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15c8c0 con 0x7fe49c0ae860 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.483+0000 7fe4a3000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15cba0 con 0x7fe49c0b03b0 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33886/0 (socket says 172.21.15.42:33886) 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 -- 172.21.15.42:0/3986858776 learned_addr learned my addr 172.21.15.42:0/3986858776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe49be00640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe49c0ae860 0x7fe49c169180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe49b400640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe49c0b03b0 0x7fe49c0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 -- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe49c0b03b0 msgr2=0x7fe49c0af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe49c0b03b0 0x7fe49c0af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 -- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe49c0ae860 msgr2=0x7fe49c169180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe49c0ae860 0x7fe49c169180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 -- 172.21.15.42:0/3986858776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c009390 con 0x7fe49c158e60 2024-08-17T02:28:12.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe49be00640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe49c0ae860 0x7fe49c169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.484+0000 7fe4a1000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0c9dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe49400cc40 tx=0x7fe494001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.485+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400ce60 con 0x7fe49c158e60 2024-08-17T02:28:12.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.485+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400a850 con 0x7fe49c158e60 2024-08-17T02:28:12.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.485+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400ac10 con 0x7fe49c158e60 2024-08-17T02:28:12.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.485+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c15ce80 con 0x7fe49c158e60 2024-08-17T02:28:12.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.485+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c15d440 con 0x7fe49c158e60 2024-08-17T02:28:12.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.486+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c15d660 con 0x7fe49c158e60 2024-08-17T02:28:12.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.487+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe494007300 con 0x7fe49c158e60 2024-08-17T02:28:12.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.487+0000 7fe493400640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe47c065150 0x7fe47c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.488+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe494082210 con 0x7fe49c158e60 2024-08-17T02:28:12.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.488+0000 7fe49be00640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe47c065150 0x7fe47c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.488+0000 7fe49be00640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe47c065150 0x7fe47c067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe48c034000 tx=0x7fe48c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.491+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe4940506a0 con 0x7fe49c158e60 2024-08-17T02:28:12.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.674+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe49c169720 con 0x7fe49c158e60 2024-08-17T02:28:12.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.674+0000 7fe493400640 1 -- 172.21.15.42:0/3986858776 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe49400b0d0 con 0x7fe49c158e60 2024-08-17T02:28:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe47c065150 msgr2=0x7fe47c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe47c065150 0x7fe47c067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe48c034000 tx=0x7fe48c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 msgr2=0x7fe49c0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0c9dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe49400cc40 tx=0x7fe494001a50 comp rx=0 tx=0).stop 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 shutdown_connections 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe47c065150 0x7fe47c067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe49c158e60 0x7fe49c0c9dd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe49c0b03b0 0x7fe49c0af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 --2- 172.21.15.42:0/3986858776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe49c0ae860 0x7fe49c169180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 >> 172.21.15.42:0/3986858776 conn(0x7fe49c0cc390 msgr2=0x7fe49c15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 shutdown_connections 2024-08-17T02:28:12.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.676+0000 7fe4a3000640 1 -- 172.21.15.42:0/3986858776 wait complete. 2024-08-17T02:28:12.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:28:12.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.843+0000 7fd8fae00640 1 Processor -- start 2024-08-17T02:28:12.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.843+0000 7fd8fae00640 1 -- start start 2024-08-17T02:28:12.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.844+0000 7fd8fae00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f4158d50 0x7fd8f40ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.844+0000 7fd8fae00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8f4159120 0x7fd8f40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.844+0000 7fd8fae00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40a96c0 con 0x7fd8f40ac9e0 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.844+0000 7fd8fae00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40acf00 con 0x7fd8f4159120 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.844+0000 7fd8fae00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40af7d0 con 0x7fd8f4158d50 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f8e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd8f40ac9e0 0x7fd8f4066e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43770/0 (socket says 172.21.15.42:43770) 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f8e00640 1 -- 172.21.15.42:0/3107790617 learned_addr learned my addr 172.21.15.42:0/3107790617 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3e00640 1 --2- 172.21.15.42:0/3107790617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f4158d50 0x7fd8f40ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3400640 1 --2- 172.21.15.42:0/3107790617 >> v2:172.21.15.62:3300/0 conn(0x7fd8f4159120 0x7fd8f40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f2a00640 1 -- 172.21.15.42:0/3107790617 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770858034 0 0) 0x7fd8f40a96c0 con 0x7fd8f40ac9e0 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f2a00640 1 -- 172.21.15.42:0/3107790617 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d80034e0 con 0x7fd8f40ac9e0 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3e00640 1 -- 172.21.15.42:0/3107790617 >> v2:172.21.15.62:3300/0 conn(0x7fd8f4159120 msgr2=0x7fd8f40ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3e00640 1 --2- 172.21.15.42:0/3107790617 >> v2:172.21.15.62:3300/0 conn(0x7fd8f4159120 0x7fd8f40ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3e00640 1 -- 172.21.15.42:0/3107790617 >> v1:172.21.15.42:6789/0 conn(0x7fd8f40ac9e0 legacy=0x7fd8f4066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3e00640 1 -- 172.21.15.42:0/3107790617 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40a98f0 con 0x7fd8f4158d50 2024-08-17T02:28:12.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.845+0000 7fd8f3400640 1 --2- 172.21.15.42:0/3107790617 >> v2:172.21.15.62:3300/0 conn(0x7fd8f4159120 0x7fd8f40ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.846+0000 7fd8f3e00640 1 --2- 172.21.15.42:0/3107790617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f4158d50 0x7fd8f40ac4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009850 tx=0x7fd8e40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9eb9aa0ae3e95f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8f2a00640 1 -- 172.21.15.42:0/3107790617 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e402ad00 con 0x7fd8f4158d50 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8f2a00640 1 -- 172.21.15.42:0/3107790617 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e402ae60 con 0x7fd8f4158d50 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8f2a00640 1 -- 172.21.15.42:0/3107790617 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4032670 con 0x7fd8f4158d50 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8fae00640 1 -- 172.21.15.42:0/3107790617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f4158d50 msgr2=0x7fd8f40ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8fae00640 1 --2- 172.21.15.42:0/3107790617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f4158d50 0x7fd8f40ac4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009850 tx=0x7fd8e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8fae00640 1 -- 172.21.15.42:0/3107790617 shutdown_connections 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8fae00640 1 --2- 172.21.15.42:0/3107790617 >> v2:172.21.15.62:3300/0 conn(0x7fd8f4159120 0x7fd8f40ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8fae00640 1 --2- 172.21.15.42:0/3107790617 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f4158d50 0x7fd8f40ac4a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.847+0000 7fd8fae00640 1 -- 172.21.15.42:0/3107790617 >> 172.21.15.42:0/3107790617 conn(0x7fd8f4095a70 msgr2=0x7fd8f4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.848+0000 7fd8fae00640 1 -- 172.21.15.42:0/3107790617 shutdown_connections 2024-08-17T02:28:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.848+0000 7fd8fae00640 1 -- 172.21.15.42:0/3107790617 wait complete. 2024-08-17T02:28:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.849+0000 7fd8fae00640 1 Processor -- start 2024-08-17T02:28:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.849+0000 7fd8fae00640 1 -- start start 2024-08-17T02:28:12.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8fae00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f40ac9e0 0x7fd8f416c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8fae00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f4158d50 0x7fd8f41691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8fae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 0x7fd8f4155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8fae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40982c0 con 0x7fd8f4159120 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8fae00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4097d00 con 0x7fd8f4158d50 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8fae00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4097fe0 con 0x7fd8f40ac9e0 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8f8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 0x7fd8f4155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f40ac9e0 0x7fd8f416c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8f8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 0x7fd8f4155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33898/0 (socket says 172.21.15.42:33898) 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8f3400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f4158d50 0x7fd8f41691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8f8e00640 1 -- 172.21.15.42:0/4068432676 learned_addr learned my addr 172.21.15.42:0/4068432676 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.850+0000 7fd8f3e00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f40ac9e0 0x7fd8f416c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:44016/0 (socket says 172.21.15.42:44016) 2024-08-17T02:28:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8f8e00640 1 -- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f40ac9e0 msgr2=0x7fd8f416c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8f8e00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f40ac9e0 0x7fd8f416c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8f8e00640 1 -- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f4158d50 msgr2=0x7fd8f41691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8f8e00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f4158d50 0x7fd8f41691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8f8e00640 1 -- 172.21.15.42:0/4068432676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0009390 con 0x7fd8f4159120 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8f8e00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 0x7fd8f4155a90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec001460 tx=0x7fd8ec001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00ce30 con 0x7fd8f4159120 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00a7f0 con 0x7fd8f4159120 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e4009390 con 0x7fd8f4159120 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00abf0 con 0x7fd8f4159120 2024-08-17T02:28:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.851+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f415b020 con 0x7fd8f4159120 2024-08-17T02:28:12.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.853+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f415aba0 con 0x7fd8f4159120 2024-08-17T02:28:12.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.853+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8ec00ad50 con 0x7fd8f4159120 2024-08-17T02:28:12.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.854+0000 7fd8eb400640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd8d4065180 0x7fd8d4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.854+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd8ec082130 con 0x7fd8f4159120 2024-08-17T02:28:12.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.854+0000 7fd8f3e00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd8d4065180 0x7fd8d4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.855+0000 7fd8f3e00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd8d4065180 0x7fd8d4067630 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4034000 tx=0x7fd8e4032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:12.858+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8f415aba0 con 0x7fd8f4159120 2024-08-17T02:28:13.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.047+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd8f415aba0 con 0x7fd8f4159120 2024-08-17T02:28:13.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.048+0000 7fd8eb400640 1 -- 172.21.15.42:0/4068432676 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd8f415aba0 con 0x7fd8f4159120 2024-08-17T02:28:13.048 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:13.048 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-08-17T02:28:13.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:13.049 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-08-17T02:28:13.049 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-08-17T02:28:13.049 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:13.049 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd8d4065180 msgr2=0x7fd8d4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd8d4065180 0x7fd8d4067630 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4034000 tx=0x7fd8e4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 msgr2=0x7fd8f4155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 0x7fd8f4155a90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec001460 tx=0x7fd8ec001a40 comp rx=0 tx=0).stop 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 shutdown_connections 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fd8d4065180 0x7fd8d4067630 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8f4159120 0x7fd8f4155a90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f4158d50 0x7fd8f41691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 --2- 172.21.15.42:0/4068432676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd8f40ac9e0 0x7fd8f416c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 >> 172.21.15.42:0/4068432676 conn(0x7fd8f4095a70 msgr2=0x7fd8f406bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 shutdown_connections 2024-08-17T02:28:13.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.050+0000 7fd8fae00640 1 -- 172.21.15.42:0/4068432676 wait complete. 2024-08-17T02:28:13.065 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:28:13.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:28:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.221+0000 7f3c23c00640 1 Processor -- start 2024-08-17T02:28:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.221+0000 7f3c23c00640 1 -- start start 2024-08-17T02:28:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c23c00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c1c0aef00 0x7f3c1c161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c23c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1c1582b0 con 0x7f3c1c156a90 2024-08-17T02:28:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c23c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1c0ca110 con 0x7f3c1c0add70 2024-08-17T02:28:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c23c00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c9f80 con 0x7f3c1c0aef00 2024-08-17T02:28:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c21200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3c1c156a90 0x7f3c1c0ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43772/0 (socket says 172.21.15.42:43772) 2024-08-17T02:28:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c21200640 1 -- 172.21.15.42:0/3794691831 learned_addr learned my addr 172.21.15.42:0/3794691831 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:13.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c21c00640 1 --2- 172.21.15.42:0/3794691831 >> v2:172.21.15.62:3300/0 conn(0x7f3c1c0aef00 0x7f3c1c161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988980215 0 0) 0x7f3c1c1582b0 con 0x7f3c1c156a90 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.223+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c040034e0 con 0x7f3c1c156a90 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669384893 0 0) 0x7f3c1c0ca110 con 0x7f3c1c0add70 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c1582b0 con 0x7f3c1c0add70 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89022826 0 0) 0x7f3c040034e0 con 0x7f3c1c156a90 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 >> v2:172.21.15.62:3300/0 conn(0x7f3c1c0aef00 msgr2=0x7f3c1c161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 --2- 172.21.15.42:0/3794691831 >> v2:172.21.15.62:3300/0 conn(0x7f3c1c0aef00 0x7f3c1c161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 >> v1:172.21.15.62:6789/0 conn(0x7f3c1c0add70 legacy=0x7f3c1c0ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c0af4b0 con 0x7f3c1c156a90 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f3c10001470 con 0x7f3c1c156a90 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 >> v1:172.21.15.42:6789/0 conn(0x7f3c1c156a90 legacy=0x7f3c1c0ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c04003bb0 0x7f3c04003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c04004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c04005180 0x7f3c0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c9f80 con 0x7f3c04004780 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0400c120 con 0x7f3c04005180 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0400c2e0 con 0x7f3c04003bb0 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c1be00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c04004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.224+0000 7f3c21200640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c04003bb0 0x7f3c04003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c21c00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c04005180 0x7f3c0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c1be00640 1 -- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c04003bb0 msgr2=0x7f3c04003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c1be00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c04003bb0 0x7f3c04003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c1be00640 1 -- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c04005180 msgr2=0x7f3c0400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c1be00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c04005180 0x7f3c0400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c1be00640 1 -- 172.21.15.42:0/3794691831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040034e0 con 0x7f3c04004780 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c21c00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c04005180 0x7f3c0400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:13.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.225+0000 7f3c21c00640 1 -- 172.21.15.42:0/3794691831 reap_dead start 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.226+0000 7f3c1be00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c04004bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3c08007fd0 tx=0x7f3c08007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f1046deaf2f067 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.226+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0802a9f0 con 0x7f3c04004780 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.226+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0802ab50 con 0x7f3c04004780 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.226+0000 7f3c1b400640 1 -- 172.21.15.42:0/3794691831 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080323f0 con 0x7f3c04004780 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.226+0000 7f3c23c00640 1 -- 172.21.15.42:0/3794691831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 msgr2=0x7f3c04004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.226+0000 7f3c23c00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c04004bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3c08007fd0 tx=0x7f3c08007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.227+0000 7f3c23c00640 1 -- 172.21.15.42:0/3794691831 shutdown_connections 2024-08-17T02:28:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.227+0000 7f3c23c00640 1 --2- 172.21.15.42:0/3794691831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c04004bf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.227+0000 7f3c23c00640 1 -- 172.21.15.42:0/3794691831 >> 172.21.15.42:0/3794691831 conn(0x7f3c1c066e60 msgr2=0x7f3c1c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.227+0000 7f3c23c00640 1 -- 172.21.15.42:0/3794691831 shutdown_connections 2024-08-17T02:28:13.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.227+0000 7f3c23c00640 1 -- 172.21.15.42:0/3794691831 wait complete. 2024-08-17T02:28:13.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.228+0000 7f3c23c00640 1 Processor -- start 2024-08-17T02:28:13.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.228+0000 7f3c23c00640 1 -- start start 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c23c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c1c1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c23c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c1c159630 0x7f3c1c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c23c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c1c14e4c0 0x7f3c1c14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c23c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c150670 con 0x7f3c04004780 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c23c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c159fe0 con 0x7f3c1c14e4c0 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c23c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c150ed0 con 0x7f3c1c159630 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c21200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c1c1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c21200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c1c1492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33906/0 (socket says 172.21.15.42:33906) 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.229+0000 7f3c21200640 1 -- 172.21.15.42:0/1082182345 learned_addr learned my addr 172.21.15.42:0/1082182345 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:13.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c1be00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c1c159630 0x7f3c1c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c1c14e4c0 0x7f3c1c14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21200640 1 -- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c1c159630 msgr2=0x7f3c1c159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21200640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c1c159630 0x7f3c1c159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21200640 1 -- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c1c14e4c0 msgr2=0x7f3c1c14e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21200640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c1c14e4c0 0x7f3c1c14e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21200640 1 -- 172.21.15.42:0/1082182345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c14ee70 con 0x7f3c04004780 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c1c14e4c0 0x7f3c1c14e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c21200640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c1c1492c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3c100077f0 tx=0x7f3c10001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10012560 con 0x7f3c04004780 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.230+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c100126e0 con 0x7f3c04004780 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.231+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c14f130 con 0x7f3c04004780 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.231+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10012aa0 con 0x7f3c04004780 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.231+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c150b60 con 0x7f3c04004780 2024-08-17T02:28:13.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.232+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c063fb0 con 0x7f3c04004780 2024-08-17T02:28:13.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.232+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c1001d460 con 0x7f3c04004780 2024-08-17T02:28:13.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.233+0000 7f3c0fe00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bfc065150 0x7f3bfc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.233+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3c10081d50 con 0x7f3c04004780 2024-08-17T02:28:13.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.233+0000 7f3c1be00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bfc065150 0x7f3bfc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.234+0000 7f3c1be00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bfc065150 0x7f3bfc067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c08032000 tx=0x7f3c08003000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.237+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3c10085030 con 0x7f3c04004780 2024-08-17T02:28:13.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.419+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3c1c1573c0 con 0x7f3c04004780 2024-08-17T02:28:13.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.871+0000 7f3c0fe00640 1 -- 172.21.15.42:0/1082182345 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3c10050160 con 0x7f3c04004780 2024-08-17T02:28:13.871 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-08-17T02:28:13.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bfc065150 msgr2=0x7f3bfc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bfc065150 0x7f3bfc067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c08032000 tx=0x7f3c08003000 comp rx=0 tx=0).stop 2024-08-17T02:28:13.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 msgr2=0x7f3c1c1492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c1c1492c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3c100077f0 tx=0x7f3c10001d20 comp rx=0 tx=0).stop 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 shutdown_connections 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3bfc065150 0x7f3bfc067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c1c14e4c0 0x7f3c1c14e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3c1c159630 0x7f3c1c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 --2- 172.21.15.42:0/1082182345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c04004780 0x7f3c1c1492c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.874+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 >> 172.21.15.42:0/1082182345 conn(0x7f3c1c066e60 msgr2=0x7f3c1c0cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.875+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 shutdown_connections 2024-08-17T02:28:13.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:13.875+0000 7f3c23c00640 1 -- 172.21.15.42:0/1082182345 wait complete. 2024-08-17T02:28:13.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:28:14.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.053+0000 7f014ee00640 1 Processor -- start 2024-08-17T02:28:14.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.054+0000 7f014ee00640 1 -- start start 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ee00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ad960 0x7f014815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ee00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01480ca050 0x7f0148156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ee00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f01480add30 0x7f0148156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ee00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014815b5e0 con 0x7f01480add30 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ee00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480cb160 con 0x7f01480ca050 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ee00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480b0d10 con 0x7f01480ad960 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ce00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f01480add30 0x7f0148156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ce00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f01480add30 0x7f0148156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33908/0 (socket says 172.21.15.42:33908) 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f014ce00640 1 -- 172.21.15.42:0/2085697557 learned_addr learned my addr 172.21.15.42:0/2085697557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f0147e00640 1 --2- 172.21.15.42:0/2085697557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ad960 0x7f014815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.055+0000 7f013f400640 1 --2- 172.21.15.42:0/2085697557 >> v2:172.21.15.62:3300/0 conn(0x7f01480ca050 0x7f0148156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.056+0000 7f014ce00640 1 -- 172.21.15.42:0/2085697557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ad960 msgr2=0x7f014815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.056+0000 7f014ce00640 1 --2- 172.21.15.42:0/2085697557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ad960 0x7f014815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.056+0000 7f014ce00640 1 -- 172.21.15.42:0/2085697557 >> v2:172.21.15.62:3300/0 conn(0x7f01480ca050 msgr2=0x7f0148156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.056+0000 7f014ce00640 1 --2- 172.21.15.42:0/2085697557 >> v2:172.21.15.62:3300/0 conn(0x7f01480ca050 0x7f0148156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.056+0000 7f014ce00640 1 -- 172.21.15.42:0/2085697557 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480ca550 con 0x7f01480add30 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.057+0000 7f014ce00640 1 --2- 172.21.15.42:0/2085697557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480add30 0x7f0148156960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f014806d1e0 tx=0x7f0140009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f97220f38330f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.057+0000 7f0147400640 1 -- 172.21.15.42:0/2085697557 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140033430 con 0x7f01480add30 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.057+0000 7f0147400640 1 -- 172.21.15.42:0/2085697557 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140033590 con 0x7f01480add30 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.057+0000 7f0147400640 1 -- 172.21.15.42:0/2085697557 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140033930 con 0x7f01480add30 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.057+0000 7f014ee00640 1 -- 172.21.15.42:0/2085697557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480add30 msgr2=0x7f0148156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.057+0000 7f014ee00640 1 --2- 172.21.15.42:0/2085697557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480add30 0x7f0148156960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f014806d1e0 tx=0x7f0140009840 comp rx=0 tx=0).stop 2024-08-17T02:28:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 -- 172.21.15.42:0/2085697557 shutdown_connections 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 --2- 172.21.15.42:0/2085697557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480add30 0x7f0148156960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 --2- 172.21.15.42:0/2085697557 >> v2:172.21.15.62:3300/0 conn(0x7f01480ca050 0x7f0148156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 --2- 172.21.15.42:0/2085697557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ad960 0x7f014815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 -- 172.21.15.42:0/2085697557 >> 172.21.15.42:0/2085697557 conn(0x7f0148066e60 msgr2=0x7f0148067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 -- 172.21.15.42:0/2085697557 shutdown_connections 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.058+0000 7f014ee00640 1 -- 172.21.15.42:0/2085697557 wait complete. 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.059+0000 7f014ee00640 1 Processor -- start 2024-08-17T02:28:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.059+0000 7f014ee00640 1 -- start start 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ee00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 0x7f01480a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ee00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01480add30 0x7f01481595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ee00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ca050 0x7f0148143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ee00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480abbb0 con 0x7f01480ad960 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ee00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148159e30 con 0x7f01480add30 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ee00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014815a110 con 0x7f01480ca050 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f0147e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 0x7f01480a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f0147e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 0x7f01480a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33922/0 (socket says 172.21.15.42:33922) 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f0147e00640 1 -- 172.21.15.42:0/529827462 learned_addr learned my addr 172.21.15.42:0/529827462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f014ce00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ca050 0x7f0148143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.060+0000 7f013f400640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01480add30 0x7f01481595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f0147e00640 1 -- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ca050 msgr2=0x7f0148143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f0147e00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ca050 0x7f0148143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f0147e00640 1 -- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01480add30 msgr2=0x7f01481595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f0147e00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01480add30 0x7f01481595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f0147e00640 1 -- 172.21.15.42:0/529827462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140009ae0 con 0x7f01480ad960 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f0147e00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 0x7f01480a9350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f013800d890 tx=0x7f0138008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800de20 con 0x7f01480ad960 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800b8d0 con 0x7f01480ad960 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800bc70 con 0x7f01480ad960 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.061+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01480ab560 con 0x7f01480ad960 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.062+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0148159b20 con 0x7f01480ad960 2024-08-17T02:28:14.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.063+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148063fb0 con 0x7f01480ad960 2024-08-17T02:28:14.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.064+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0138014640 con 0x7f01480ad960 2024-08-17T02:28:14.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.065+0000 7f013fe00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0124065180 0x7f0124067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.065+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f0138082730 con 0x7f01480ad960 2024-08-17T02:28:14.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.065+0000 7f013f400640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0124065180 0x7f0124067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.066+0000 7f013f400640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0124065180 0x7f0124067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0148156640 tx=0x7f0130008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.070+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0138050b40 con 0x7f01480ad960 2024-08-17T02:28:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.251+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f014806e5c0 con 0x7f01480ad960 2024-08-17T02:28:14.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.875+0000 7f013fe00640 1 -- 172.21.15.42:0/529827462 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0138054160 con 0x7f01480ad960 2024-08-17T02:28:14.876 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-08-17T02:28:14.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0124065180 msgr2=0x7f0124067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0124065180 0x7f0124067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0148156640 tx=0x7f0130008040 comp rx=0 tx=0).stop 2024-08-17T02:28:14.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 msgr2=0x7f01480a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 0x7f01480a9350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f013800d890 tx=0x7f0138008040 comp rx=0 tx=0).stop 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 shutdown_connections 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0124065180 0x7f0124067630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f01480ca050 0x7f0148143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.885+0000 7f014ee00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01480add30 0x7f01481595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.886+0000 7f014ee00640 1 --2- 172.21.15.42:0/529827462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01480ad960 0x7f01480a9350 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.886+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 >> 172.21.15.42:0/529827462 conn(0x7f0148066e60 msgr2=0x7f014806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.887+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 shutdown_connections 2024-08-17T02:28:14.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:14.887+0000 7f014ee00640 1 -- 172.21.15.42:0/529827462 wait complete. 2024-08-17T02:28:14.915 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:28:15.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.071+0000 7fe2b7a00640 1 Processor -- start 2024-08-17T02:28:15.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.071+0000 7fe2b7a00640 1 -- start start 2024-08-17T02:28:15.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.072+0000 7fe2b7a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2b00ad960 0x7fe2b015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.072+0000 7fe2b7a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe2b00ca050 0x7fe2b0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.072+0000 7fe2b7a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b015b5e0 con 0x7fe2b00add30 2024-08-17T02:28:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.072+0000 7fe2b7a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00cb160 con 0x7fe2b00ca050 2024-08-17T02:28:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.072+0000 7fe2b7a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00b0d10 con 0x7fe2b00ad960 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2afe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe2b00ca050 0x7fe2b0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2b5a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe2b00add30 0x7fe2b0156960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43784/0 (socket says 172.21.15.42:43784) 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2b5a00640 1 -- 172.21.15.42:0/3332083294 learned_addr learned my addr 172.21.15.42:0/3332083294 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2b5000640 1 --2- 172.21.15.42:0/3332083294 >> v2:172.21.15.62:3300/0 conn(0x7fe2b00ad960 0x7fe2b015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2afe00640 1 -- 172.21.15.42:0/3332083294 >> v2:172.21.15.62:3300/0 conn(0x7fe2b00ad960 msgr2=0x7fe2b015b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2afe00640 1 --2- 172.21.15.42:0/3332083294 >> v2:172.21.15.62:3300/0 conn(0x7fe2b00ad960 0x7fe2b015b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2afe00640 1 -- 172.21.15.42:0/3332083294 >> v1:172.21.15.42:6789/0 conn(0x7fe2b00add30 legacy=0x7fe2b0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.073+0000 7fe2afe00640 1 -- 172.21.15.42:0/3332083294 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00ca550 con 0x7fe2b00ca050 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.074+0000 7fe2afe00640 1 --2- 172.21.15.42:0/3332083294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b0156420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00cc910 tx=0x7fe29c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afeda95df860d0d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2af400640 1 -- 172.21.15.42:0/3332083294 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c02ae40 con 0x7fe2b00ca050 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2af400640 1 -- 172.21.15.42:0/3332083294 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c032440 con 0x7fe2b00ca050 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2af400640 1 -- 172.21.15.42:0/3332083294 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c032820 con 0x7fe2b00ca050 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 -- 172.21.15.42:0/3332083294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 msgr2=0x7fe2b0156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/3332083294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b0156420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00cc910 tx=0x7fe29c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 -- 172.21.15.42:0/3332083294 shutdown_connections 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/3332083294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b0156420 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/3332083294 >> v2:172.21.15.62:3300/0 conn(0x7fe2b00ad960 0x7fe2b015b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 -- 172.21.15.42:0/3332083294 >> 172.21.15.42:0/3332083294 conn(0x7fe2b0066e60 msgr2=0x7fe2b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 -- 172.21.15.42:0/3332083294 shutdown_connections 2024-08-17T02:28:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.075+0000 7fe2b7a00640 1 -- 172.21.15.42:0/3332083294 wait complete. 2024-08-17T02:28:15.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.077+0000 7fe2b7a00640 1 Processor -- start 2024-08-17T02:28:15.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.077+0000 7fe2b7a00640 1 -- start start 2024-08-17T02:28:15.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b7a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00ad960 0x7fe2b014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b7a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00add30 0x7fe2b006a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00a9590 con 0x7fe2b00ca050 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b7a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00a8980 con 0x7fe2b00ad960 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b7a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00a8c60 con 0x7fe2b00add30 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b015bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33942/0 (socket says 172.21.15.42:33942) 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 -- 172.21.15.42:0/1978125223 learned_addr learned my addr 172.21.15.42:0/1978125223 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 -- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00add30 msgr2=0x7fe2b006a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00add30 0x7fe2b006a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5000640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00ad960 0x7fe2b014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 -- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00ad960 msgr2=0x7fe2b014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00ad960 0x7fe2b014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5a00640 1 -- 172.21.15.42:0/1978125223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c009390 con 0x7fe2b00ca050 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.078+0000 7fe2b5000640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00ad960 0x7fe2b014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:15.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.079+0000 7fe2b5a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b015bb60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800cc40 tx=0x7fe2a8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.079+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800ce60 con 0x7fe2b00ca050 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.079+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a800a850 con 0x7fe2b00ca050 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.079+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800ac10 con 0x7fe2b00ca050 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.079+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b00a8f40 con 0x7fe2b00ca050 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.079+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b014ac60 con 0x7fe2b00ca050 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.080+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b0063fb0 con 0x7fe2b00ca050 2024-08-17T02:28:15.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.081+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2a8007300 con 0x7fe2b00ca050 2024-08-17T02:28:15.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.082+0000 7fe2a3e00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe290065150 0x7fe290067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.082+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe2a8082440 con 0x7fe2b00ca050 2024-08-17T02:28:15.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.082+0000 7fe2b5000640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe290065150 0x7fe290067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.083+0000 7fe2b5000640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe290065150 0x7fe290067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006e70 tx=0x7fe2a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.086+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2a8050540 con 0x7fe2b00ca050 2024-08-17T02:28:15.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.306+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe2b015b5e0 con 0x7fe2b00ca050 2024-08-17T02:28:15.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.904+0000 7fe2a3e00640 1 -- 172.21.15.42:0/1978125223 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe2b015b5e0 con 0x7fe2b00ca050 2024-08-17T02:28:15.906 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:28:15.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.915+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe290065150 msgr2=0x7fe290067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.915+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe290065150 0x7fe290067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4006e70 tx=0x7fe2a4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.915+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 msgr2=0x7fe2b015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.915+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b015bb60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800cc40 tx=0x7fe2a8001a50 comp rx=0 tx=0).stop 2024-08-17T02:28:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.916+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 shutdown_connections 2024-08-17T02:28:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.916+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fe290065150 0x7fe290067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.916+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2b00ca050 0x7fe2b015bb60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.916+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe2b00add30 0x7fe2b006a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.916+0000 7fe2b7a00640 1 --2- 172.21.15.42:0/1978125223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2b00ad960 0x7fe2b014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.917+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 >> 172.21.15.42:0/1978125223 conn(0x7fe2b0066e60 msgr2=0x7fe2b01548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.918+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 shutdown_connections 2024-08-17T02:28:15.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:15.918+0000 7fe2b7a00640 1 -- 172.21.15.42:0/1978125223 wait complete. 2024-08-17T02:28:15.943 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:16.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.096+0000 7f784d000640 1 Processor -- start 2024-08-17T02:28:16.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.096+0000 7f784d000640 1 -- start start 2024-08-17T02:28:16.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f784d000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f78480acf10 0x7f78480b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f784d000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480c92b0 con 0x7f78480afca0 2024-08-17T02:28:16.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f784d000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480ad480 con 0x7f78481590b0 2024-08-17T02:28:16.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f784d000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480b0980 con 0x7f78480acf10 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f7845e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f78480afca0 0x7f78481589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43788/0 (socket says 172.21.15.42:43788) 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f7845e00640 1 -- 172.21.15.42:0/1411548830 learned_addr learned my addr 172.21.15.42:0/1411548830 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.097+0000 7f7846800640 1 --2- 172.21.15.42:0/1411548830 >> v2:172.21.15.42:3300/0 conn(0x7f78480acf10 0x7f78480b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.098+0000 7f7844a00640 1 -- 172.21.15.42:0/1411548830 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210161842 0 0) 0x7f78480c92b0 con 0x7f78480afca0 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.098+0000 7f7844a00640 1 -- 172.21.15.42:0/1411548830 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f782c0034e0 con 0x7f78480afca0 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.098+0000 7f7846800640 1 -- 172.21.15.42:0/1411548830 >> v1:172.21.15.62:6789/0 conn(0x7f78481590b0 legacy=0x7f78480c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.098+0000 7f7846800640 1 -- 172.21.15.42:0/1411548830 >> v1:172.21.15.42:6789/0 conn(0x7f78480afca0 legacy=0x7f78481589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.098+0000 7f7846800640 1 -- 172.21.15.42:0/1411548830 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480ad760 con 0x7f78480acf10 2024-08-17T02:28:16.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.099+0000 7f7846800640 1 --2- 172.21.15.42:0/1411548830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f78480b0070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7840009e60 tx=0x7f7840009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225b13a70962c9d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.099+0000 7f7844a00640 1 -- 172.21.15.42:0/1411548830 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840007550 con 0x7f78480acf10 2024-08-17T02:28:16.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.099+0000 7f7844a00640 1 -- 172.21.15.42:0/1411548830 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784002d050 con 0x7f78480acf10 2024-08-17T02:28:16.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.099+0000 7f7844a00640 1 -- 172.21.15.42:0/1411548830 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400078c0 con 0x7f78480acf10 2024-08-17T02:28:16.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 -- 172.21.15.42:0/1411548830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 msgr2=0x7f78480b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 --2- 172.21.15.42:0/1411548830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f78480b0070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7840009e60 tx=0x7f7840009780 comp rx=0 tx=0).stop 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 -- 172.21.15.42:0/1411548830 shutdown_connections 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 --2- 172.21.15.42:0/1411548830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f78480b0070 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 -- 172.21.15.42:0/1411548830 >> 172.21.15.42:0/1411548830 conn(0x7f7848066e60 msgr2=0x7f7848067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 -- 172.21.15.42:0/1411548830 shutdown_connections 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.100+0000 7f784d000640 1 -- 172.21.15.42:0/1411548830 wait complete. 2024-08-17T02:28:16.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.101+0000 7f784d000640 1 Processor -- start 2024-08-17T02:28:16.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.101+0000 7f784d000640 1 -- start start 2024-08-17T02:28:16.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.102+0000 7f784d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f784815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.102+0000 7f784d000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78480afca0 0x7f7848169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.102+0000 7f784d000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78481590b0 0x7f7848151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.102+0000 7f784d000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848169f40 con 0x7f78480acf10 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.102+0000 7f784d000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481524a0 con 0x7f78480afca0 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.102+0000 7f784d000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784815ceb0 con 0x7f78481590b0 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f784815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f784815c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33952/0 (socket says 172.21.15.42:33952) 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 -- 172.21.15.42:0/1472581687 learned_addr learned my addr 172.21.15.42:0/1472581687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7846800640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78481590b0 0x7f7848151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845400640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78480afca0 0x7f7848169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 -- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78481590b0 msgr2=0x7f7848151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78481590b0 0x7f7848151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 -- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78480afca0 msgr2=0x7f7848169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78480afca0 0x7f7848169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 -- 172.21.15.42:0/1472581687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009a20 con 0x7f78480acf10 2024-08-17T02:28:16.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.103+0000 7f7845e00640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f784815c8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f783800c5e0 tx=0x7f7838007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.104+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838005b70 con 0x7f78480acf10 2024-08-17T02:28:16.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.104+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838005cf0 con 0x7f78480acf10 2024-08-17T02:28:16.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.104+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838005ea0 con 0x7f78480acf10 2024-08-17T02:28:16.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.104+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784815d190 con 0x7f78480acf10 2024-08-17T02:28:16.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.104+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784815da30 con 0x7f78480acf10 2024-08-17T02:28:16.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.105+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784815d590 con 0x7f78480acf10 2024-08-17T02:28:16.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.106+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f783801b400 con 0x7f78480acf10 2024-08-17T02:28:16.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.107+0000 7f783d600640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7828065150 0x7f7828067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.107+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7838081e90 con 0x7f78480acf10 2024-08-17T02:28:16.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.107+0000 7f7845400640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7828065150 0x7f7828067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.107+0000 7f7845400640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7828065150 0x7f7828067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f784815cde0 tx=0x7f7834007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.110+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f783804ffe0 con 0x7f78480acf10 2024-08-17T02:28:16.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.295+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7848063fb0 con 0x7f78480acf10 2024-08-17T02:28:16.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.296+0000 7f783d600640 1 -- 172.21.15.42:0/1472581687 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f7838053600 con 0x7f78480acf10 2024-08-17T02:28:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:16.296 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:15.307859+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7828065150 msgr2=0x7f7828067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7828065150 0x7f7828067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f784815cde0 tx=0x7f7834007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 msgr2=0x7f784815c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f784815c8a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f783800c5e0 tx=0x7f7838007d70 comp rx=0 tx=0).stop 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 shutdown_connections 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7828065150 0x7f7828067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f78481590b0 0x7f7848151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78480afca0 0x7f7848169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 --2- 172.21.15.42:0/1472581687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78480acf10 0x7f784815c8a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 >> 172.21.15.42:0/1472581687 conn(0x7f7848066e60 msgr2=0x7f784806ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 shutdown_connections 2024-08-17T02:28:16.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.298+0000 7f784d000640 1 -- 172.21.15.42:0/1472581687 wait complete. 2024-08-17T02:28:16.314 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.465+0000 7ffab4c00640 1 Processor -- start 2024-08-17T02:28:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.466+0000 7ffab4c00640 1 -- start start 2024-08-17T02:28:16.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffab4c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab00b0e30 0x7ffab00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffab4c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab006d7c0 con 0x7ffab0156f90 2024-08-17T02:28:16.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffab4c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab015ab30 con 0x7ffab015a590 2024-08-17T02:28:16.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffab4c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab015ae10 con 0x7ffab00b0e30 2024-08-17T02:28:16.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffaa7e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ffab0156f90 0x7ffab00cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43796/0 (socket says 172.21.15.42:43796) 2024-08-17T02:28:16.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffaa7e00640 1 -- 172.21.15.42:0/4251402027 learned_addr learned my addr 172.21.15.42:0/4251402027 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:16.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.467+0000 7ffaaf400640 1 --2- 172.21.15.42:0/4251402027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab00b0e30 0x7ffab00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036578818 0 0) 0x7ffab006d7c0 con 0x7ffab0156f90 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa940034e0 con 0x7ffab0156f90 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049140760 0 0) 0x7ffab015ab30 con 0x7ffab015a590 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab006d7c0 con 0x7ffab015a590 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaf400640 1 -- 172.21.15.42:0/4251402027 >> v1:172.21.15.62:6789/0 conn(0x7ffab015a590 legacy=0x7ffab013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaf400640 1 -- 172.21.15.42:0/4251402027 >> v1:172.21.15.42:6789/0 conn(0x7ffab0156f90 legacy=0x7ffab00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.468+0000 7ffaaf400640 1 -- 172.21.15.42:0/4251402027 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab015b0f0 con 0x7ffab00b0e30 2024-08-17T02:28:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.469+0000 7ffaaf400640 1 --2- 172.21.15.42:0/4251402027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab00b0e30 0x7ffab00b1200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009880 tx=0x7ffaa00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb85e0f7d6d550f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.469+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa002ae20 con 0x7ffab00b0e30 2024-08-17T02:28:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.469+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0032440 con 0x7ffab00b0e30 2024-08-17T02:28:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.469+0000 7ffaaea00640 1 -- 172.21.15.42:0/4251402027 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00327c0 con 0x7ffab00b0e30 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 -- 172.21.15.42:0/4251402027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab00b0e30 msgr2=0x7ffab00b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 --2- 172.21.15.42:0/4251402027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab00b0e30 0x7ffab00b1200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009880 tx=0x7ffaa00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 -- 172.21.15.42:0/4251402027 shutdown_connections 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 --2- 172.21.15.42:0/4251402027 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab00b0e30 0x7ffab00b1200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 -- 172.21.15.42:0/4251402027 >> 172.21.15.42:0/4251402027 conn(0x7ffab0062af0 msgr2=0x7ffab0062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 -- 172.21.15.42:0/4251402027 shutdown_connections 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.470+0000 7ffab4c00640 1 -- 172.21.15.42:0/4251402027 wait complete. 2024-08-17T02:28:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.471+0000 7ffab4c00640 1 Processor -- start 2024-08-17T02:28:16.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.471+0000 7ffab4c00640 1 -- start start 2024-08-17T02:28:16.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.472+0000 7ffab4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 0x7ffab015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.472+0000 7ffab4c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffab0156f90 0x7ffab0155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.472+0000 7ffab4c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab015a590 0x7ffab0156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.472+0000 7ffab4c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0160910 con 0x7ffab00b0e30 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.472+0000 7ffab4c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00c55c0 con 0x7ffab0156f90 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.472+0000 7ffab4c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0160070 con 0x7ffab015a590 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 0x7ffab015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 0x7ffab015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33956/0 (socket says 172.21.15.42:33956) 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 -- 172.21.15.42:0/132667035 learned_addr learned my addr 172.21.15.42:0/132667035 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaa7e00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffab0156f90 0x7ffab0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaafe00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab015a590 0x7ffab0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 -- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab015a590 msgr2=0x7ffab0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab015a590 0x7ffab0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 -- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffab0156f90 msgr2=0x7ffab0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffab0156f90 0x7ffab0155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 -- 172.21.15.42:0/132667035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009390 con 0x7ffab00b0e30 2024-08-17T02:28:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.473+0000 7ffaaf400640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 0x7ffab015d290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009880 tx=0x7ffaa0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.474+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0031880 con 0x7ffab00b0e30 2024-08-17T02:28:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.474+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0031a00 con 0x7ffab00b0e30 2024-08-17T02:28:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.474+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab0160350 con 0x7ffab00b0e30 2024-08-17T02:28:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.474+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0031dc0 con 0x7ffab00b0e30 2024-08-17T02:28:16.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.474+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab015d7d0 con 0x7ffab00b0e30 2024-08-17T02:28:16.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.475+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00c5390 con 0x7ffab00b0e30 2024-08-17T02:28:16.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.476+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffaa003c400 con 0x7ffab00b0e30 2024-08-17T02:28:16.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.476+0000 7ffaa6a00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ffa8c065150 0x7ffa8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.476+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffaa00a2850 con 0x7ffab00b0e30 2024-08-17T02:28:16.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.477+0000 7ffaa7e00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ffa8c065150 0x7ffa8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.477+0000 7ffaa7e00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ffa8c065150 0x7ffa8c067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffab00c7250 tx=0x7ffa98009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.481+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffaa0070910 con 0x7ffab00b0e30 2024-08-17T02:28:16.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.663+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffab0070720 con 0x7ffab00b0e30 2024-08-17T02:28:16.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.664+0000 7ffaa6a00640 1 -- 172.21.15.42:0/132667035 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7ffaa0073f30 con 0x7ffab00b0e30 2024-08-17T02:28:16.664 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:16.665 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:15.307859+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:16.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ffa8c065150 msgr2=0x7ffa8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ffa8c065150 0x7ffa8c067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffab00c7250 tx=0x7ffa98009040 comp rx=0 tx=0).stop 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 msgr2=0x7ffab015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 0x7ffab015d290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009880 tx=0x7ffaa0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 shutdown_connections 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ffa8c065150 0x7ffa8c067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffab015a590 0x7ffab0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffab0156f90 0x7ffab0155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 --2- 172.21.15.42:0/132667035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffab00b0e30 0x7ffab015d290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 >> 172.21.15.42:0/132667035 conn(0x7ffab0062af0 msgr2=0x7ffab0139f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 shutdown_connections 2024-08-17T02:28:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.666+0000 7ffab4c00640 1 -- 172.21.15.42:0/132667035 wait complete. 2024-08-17T02:28:16.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:28:16.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.835+0000 7f5954a00640 1 Processor -- start 2024-08-17T02:28:16.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.835+0000 7f5954a00640 1 -- start start 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f5954a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5950158bf0 0x7f59500a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f5954a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59500aa430 0x7f59500aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f5954a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59500a88e0 con 0x7f595015a4d0 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f5954a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500aadf0 con 0x7f59500aa430 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f5954a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59500a9180 con 0x7f5950158bf0 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f594e800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f595015a4d0 0x7f595015a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43808/0 (socket says 172.21.15.42:43808) 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f594e800640 1 -- 172.21.15.42:0/3702146109 learned_addr learned my addr 172.21.15.42:0/3702146109 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.836+0000 7f594d400640 1 --2- 172.21.15.42:0/3702146109 >> v2:172.21.15.42:3300/0 conn(0x7f59500aa430 0x7f59500aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.837+0000 7f594de00640 1 --2- 172.21.15.42:0/3702146109 >> v2:172.21.15.62:3300/0 conn(0x7f5950158bf0 0x7f59500a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.837+0000 7f594d400640 1 -- 172.21.15.42:0/3702146109 >> v2:172.21.15.62:3300/0 conn(0x7f5950158bf0 msgr2=0x7f59500a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.837+0000 7f594d400640 1 --2- 172.21.15.42:0/3702146109 >> v2:172.21.15.62:3300/0 conn(0x7f5950158bf0 0x7f59500a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.837+0000 7f594d400640 1 -- 172.21.15.42:0/3702146109 >> v1:172.21.15.42:6789/0 conn(0x7f595015a4d0 legacy=0x7f595015a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.837+0000 7f594d400640 1 -- 172.21.15.42:0/3702146109 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595015a0e0 con 0x7f59500aa430 2024-08-17T02:28:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.837+0000 7f594ca00640 1 -- 172.21.15.42:0/3702146109 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502959245 0 0) 0x7f59500a88e0 con 0x7f595015a4d0 2024-08-17T02:28:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.838+0000 7f594d400640 1 --2- 172.21.15.42:0/3702146109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59500aa430 0x7f59500aa8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f595006cd50 tx=0x7f593c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b5d147c6aa23f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.838+0000 7f594ca00640 1 -- 172.21.15.42:0/3702146109 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c02adb0 con 0x7f59500aa430 2024-08-17T02:28:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.838+0000 7f594ca00640 1 -- 172.21.15.42:0/3702146109 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c032440 con 0x7f59500aa430 2024-08-17T02:28:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.838+0000 7f594ca00640 1 -- 172.21.15.42:0/3702146109 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c0327e0 con 0x7f59500aa430 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 -- 172.21.15.42:0/3702146109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59500aa430 msgr2=0x7f59500aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 --2- 172.21.15.42:0/3702146109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59500aa430 0x7f59500aa8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f595006cd50 tx=0x7f593c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 -- 172.21.15.42:0/3702146109 shutdown_connections 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 --2- 172.21.15.42:0/3702146109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59500aa430 0x7f59500aa8b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 --2- 172.21.15.42:0/3702146109 >> v2:172.21.15.62:3300/0 conn(0x7f5950158bf0 0x7f59500a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 -- 172.21.15.42:0/3702146109 >> 172.21.15.42:0/3702146109 conn(0x7f5950066e60 msgr2=0x7f5950067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 -- 172.21.15.42:0/3702146109 shutdown_connections 2024-08-17T02:28:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.839+0000 7f5954a00640 1 -- 172.21.15.42:0/3702146109 wait complete. 2024-08-17T02:28:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.840+0000 7f5954a00640 1 Processor -- start 2024-08-17T02:28:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.840+0000 7f5954a00640 1 -- start start 2024-08-17T02:28:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.841+0000 7f5954a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59500aa430 0x7f59500ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.841+0000 7f5954a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5950158bf0 0x7f59500c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.841+0000 7f5954a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 0x7f59500c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.841+0000 7f5954a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5950152a90 con 0x7f595015a4d0 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.841+0000 7f5954a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c9710 con 0x7f5950158bf0 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.841+0000 7f5954a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5950169410 con 0x7f59500aa430 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 0x7f59500c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 0x7f59500c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33970/0 (socket says 172.21.15.42:33970) 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594e800640 1 -- 172.21.15.42:0/3133588875 learned_addr learned my addr 172.21.15.42:0/3133588875 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5950158bf0 0x7f59500c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594de00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59500aa430 0x7f59500ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 -- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59500aa430 msgr2=0x7f59500ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59500aa430 0x7f59500ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 -- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 msgr2=0x7f59500c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 0x7f59500c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 -- 172.21.15.42:0/3133588875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c009390 con 0x7f5950158bf0 2024-08-17T02:28:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594e800640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 0x7f59500c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:16.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.842+0000 7f594d400640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5950158bf0 0x7f59500c91d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f593c031000 tx=0x7f593c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.843+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c031de0 con 0x7f5950158bf0 2024-08-17T02:28:16.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.843+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c03d420 con 0x7f5950158bf0 2024-08-17T02:28:16.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.843+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c03d7e0 con 0x7f5950158bf0 2024-08-17T02:28:16.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.843+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59500c9910 con 0x7f5950158bf0 2024-08-17T02:28:16.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.843+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59500c9ed0 con 0x7f5950158bf0 2024-08-17T02:28:16.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.844+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5950063fb0 con 0x7f5950158bf0 2024-08-17T02:28:16.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.845+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f593c039040 con 0x7f5950158bf0 2024-08-17T02:28:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.846+0000 7f5945600640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5930065150 0x7f5930067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.846+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f593c0a2440 con 0x7f5950158bf0 2024-08-17T02:28:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.846+0000 7f594de00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5930065150 0x7f5930067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.846+0000 7f594de00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5930065150 0x7f5930067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5940009c80 tx=0x7f59400090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:16.851+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f593c070510 con 0x7f5950158bf0 2024-08-17T02:28:17.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.077+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5950169550 con 0x7f5950158bf0 2024-08-17T02:28:17.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.905+0000 7f5945600640 1 -- 172.21.15.42:0/3133588875 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f593c073b30 con 0x7f5950158bf0 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5930065150 msgr2=0x7f5930067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5930065150 0x7f5930067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5940009c80 tx=0x7f59400090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5950158bf0 msgr2=0x7f59500c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5950158bf0 0x7f59500c91d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f593c031000 tx=0x7f593c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 shutdown_connections 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5930065150 0x7f5930067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f595015a4d0 0x7f59500c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5950158bf0 0x7f59500c91d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 --2- 172.21.15.42:0/3133588875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59500aa430 0x7f59500ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 >> 172.21.15.42:0/3133588875 conn(0x7f5950066e60 msgr2=0x7f5950069c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 shutdown_connections 2024-08-17T02:28:17.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:17.908+0000 7f5954a00640 1 -- 172.21.15.42:0/3133588875 wait complete. 2024-08-17T02:28:17.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.085+0000 7f028a600640 1 Processor -- start 2024-08-17T02:28:18.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.086+0000 7f028a600640 1 -- start start 2024-08-17T02:28:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f028a600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02840ae7d0 0x7f02840ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f028a600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0284156cd0 0x7f02840adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f028a600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02840b08d0 con 0x7f0284156900 2024-08-17T02:28:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f028a600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02840b0b10 con 0x7f0284156cd0 2024-08-17T02:28:18.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f028a600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02840b0df0 con 0x7f02840ae7d0 2024-08-17T02:28:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0289200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0284156900 0x7f02840b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43818/0 (socket says 172.21.15.42:43818) 2024-08-17T02:28:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0289c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0284156cd0 0x7f02840adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0289200640 1 -- 172.21.15.42:0/153935648 learned_addr learned my addr 172.21.15.42:0/153935648 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:18.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0283e00640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02840ae7d0 0x7f02840ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0289c00640 1 -- 172.21.15.42:0/153935648 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02840ae7d0 msgr2=0x7f02840ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0289c00640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02840ae7d0 0x7f02840ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.087+0000 7f0289c00640 1 -- 172.21.15.42:0/153935648 >> v1:172.21.15.42:6789/0 conn(0x7f0284156900 legacy=0x7f02840b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.088+0000 7f0289c00640 1 -- 172.21.15.42:0/153935648 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840b10d0 con 0x7f0284156cd0 2024-08-17T02:28:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.088+0000 7f0283e00640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02840ae7d0 0x7f02840ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.088+0000 7f0289c00640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0284156cd0 0x7f02840adfb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f027c009e60 tx=0x7f027c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1806ad7e5e1dc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f0283400640 1 -- 172.21.15.42:0/153935648 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c007550 con 0x7f0284156cd0 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f0283400640 1 -- 172.21.15.42:0/153935648 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c02d050 con 0x7f0284156cd0 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f0283400640 1 -- 172.21.15.42:0/153935648 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c007920 con 0x7f0284156cd0 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 -- 172.21.15.42:0/153935648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0284156cd0 msgr2=0x7f02840adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0284156cd0 0x7f02840adfb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f027c009e60 tx=0x7f027c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 -- 172.21.15.42:0/153935648 shutdown_connections 2024-08-17T02:28:18.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0284156cd0 0x7f02840adfb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 --2- 172.21.15.42:0/153935648 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f02840ae7d0 0x7f02840ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 -- 172.21.15.42:0/153935648 >> 172.21.15.42:0/153935648 conn(0x7f0284067930 msgr2=0x7f02840cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 -- 172.21.15.42:0/153935648 shutdown_connections 2024-08-17T02:28:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.089+0000 7f028a600640 1 -- 172.21.15.42:0/153935648 wait complete. 2024-08-17T02:28:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.091+0000 7f028a600640 1 Processor -- start 2024-08-17T02:28:18.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.091+0000 7f028a600640 1 -- start start 2024-08-17T02:28:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f028a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 0x7f02841505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f028a600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0284156900 0x7f0284069c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f028a600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0284156cd0 0x7f0284158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f028a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284152d30 con 0x7f02840ae7d0 2024-08-17T02:28:18.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f028a600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284155290 con 0x7f0284156900 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f028a600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0284150b30 con 0x7f0284156cd0 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 0x7f02841505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 0x7f02841505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33990/0 (socket says 172.21.15.42:33990) 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 -- 172.21.15.42:0/174959866 learned_addr learned my addr 172.21.15.42:0/174959866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0283e00640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0284156900 0x7f0284069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289c00640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0284156cd0 0x7f0284158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 -- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0284156cd0 msgr2=0x7f0284158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0284156cd0 0x7f0284158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 -- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0284156900 msgr2=0x7f0284069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0284156900 0x7f0284069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.092+0000 7f0289200640 1 -- 172.21.15.42:0/174959866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c009a20 con 0x7f02840ae7d0 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.093+0000 7f0289200640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 0x7f02841505f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f027800c590 tx=0x7f0278007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.093+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0278005aa0 con 0x7f02840ae7d0 2024-08-17T02:28:18.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.093+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0278005c20 con 0x7f02840ae7d0 2024-08-17T02:28:18.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.093+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028416a440 con 0x7f02840ae7d0 2024-08-17T02:28:18.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.093+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780070f0 con 0x7f02840ae7d0 2024-08-17T02:28:18.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.093+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0284153260 con 0x7f02840ae7d0 2024-08-17T02:28:18.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.094+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284155450 con 0x7f02840ae7d0 2024-08-17T02:28:18.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.095+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0278007540 con 0x7f02840ae7d0 2024-08-17T02:28:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.096+0000 7f0277e00640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0264065150 0x7f0264067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.096+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0278081640 con 0x7f02840ae7d0 2024-08-17T02:28:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.096+0000 7f0283e00640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0264065150 0x7f0264067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.096+0000 7f0283e00640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0264065150 0x7f0264067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0270006e70 tx=0x7f0270008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.099+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f027804f6e0 con 0x7f02840ae7d0 2024-08-17T02:28:18.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.320+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f02840b08d0 con 0x7f02840ae7d0 2024-08-17T02:28:18.852 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-08-17T02:28:18.852+0000 7fa178400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:18.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.910+0000 7f0277e00640 1 -- 172.21.15.42:0/174959866 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f02840b08d0 con 0x7f02840ae7d0 2024-08-17T02:28:18.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.913+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0264065150 msgr2=0x7f0264067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.913+0000 7f028a600640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0264065150 0x7f0264067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0270006e70 tx=0x7f0270008040 comp rx=0 tx=0).stop 2024-08-17T02:28:18.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.913+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 msgr2=0x7f02841505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.913+0000 7f028a600640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 0x7f02841505f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f027800c590 tx=0x7f0278007ee0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 shutdown_connections 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0264065150 0x7f0264067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0284156cd0 0x7f0284158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0284156900 0x7f0284069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 --2- 172.21.15.42:0/174959866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02840ae7d0 0x7f02841505f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 >> 172.21.15.42:0/174959866 conn(0x7f0284067930 msgr2=0x7f02840acc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 shutdown_connections 2024-08-17T02:28:18.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:18.914+0000 7f028a600640 1 -- 172.21.15.42:0/174959866 wait complete. 2024-08-17T02:28:18.933 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:19.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.090+0000 7fa256400640 1 Processor -- start 2024-08-17T02:28:19.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.090+0000 7fa256400640 1 -- start start 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa256400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2500afca0 0x7fa2500b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa256400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2501590b0 0x7fa250159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa256400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25015a4e0 con 0x7fa2500acf10 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa256400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500b0980 con 0x7fa2500afca0 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa256400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500c92b0 con 0x7fa2501590b0 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa24ea00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa2500acf10 0x7fa2501589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43824/0 (socket says 172.21.15.42:43824) 2024-08-17T02:28:19.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa24ea00640 1 -- 172.21.15.42:0/1918177320 learned_addr learned my addr 172.21.15.42:0/1918177320 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.091+0000 7fa24f400640 1 --2- 172.21.15.42:0/1918177320 >> v2:172.21.15.42:3300/0 conn(0x7fa2500afca0 0x7fa2500b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.092+0000 7fa24fe00640 1 --2- 172.21.15.42:0/1918177320 >> v2:172.21.15.62:3300/0 conn(0x7fa2501590b0 0x7fa250159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.092+0000 7fa24e000640 1 -- 172.21.15.42:0/1918177320 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025464496 0 0) 0x7fa23c001110 con 0x7fa2500acf10 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.092+0000 7fa24f400640 1 -- 172.21.15.42:0/1918177320 >> v2:172.21.15.62:3300/0 conn(0x7fa2501590b0 msgr2=0x7fa250159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.092+0000 7fa24f400640 1 --2- 172.21.15.42:0/1918177320 >> v2:172.21.15.62:3300/0 conn(0x7fa2501590b0 0x7fa250159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.092+0000 7fa24f400640 1 -- 172.21.15.42:0/1918177320 >> v1:172.21.15.42:6789/0 conn(0x7fa2500acf10 legacy=0x7fa2501589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.092+0000 7fa24f400640 1 -- 172.21.15.42:0/1918177320 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500ad480 con 0x7fa2500afca0 2024-08-17T02:28:19.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.093+0000 7fa24f400640 1 --2- 172.21.15.42:0/1918177320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa2500b0070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2500cb4a0 tx=0x7fa2400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffe091c3e1aa765 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.093+0000 7fa24e000640 1 -- 172.21.15.42:0/1918177320 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24002adb0 con 0x7fa2500afca0 2024-08-17T02:28:19.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.093+0000 7fa24e000640 1 -- 172.21.15.42:0/1918177320 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa240032440 con 0x7fa2500afca0 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.093+0000 7fa24e000640 1 -- 172.21.15.42:0/1918177320 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2400327e0 con 0x7fa2500afca0 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 -- 172.21.15.42:0/1918177320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 msgr2=0x7fa2500b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 --2- 172.21.15.42:0/1918177320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa2500b0070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa2500cb4a0 tx=0x7fa2400090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 -- 172.21.15.42:0/1918177320 shutdown_connections 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 --2- 172.21.15.42:0/1918177320 >> v2:172.21.15.62:3300/0 conn(0x7fa2501590b0 0x7fa250159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 --2- 172.21.15.42:0/1918177320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa2500b0070 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 -- 172.21.15.42:0/1918177320 >> 172.21.15.42:0/1918177320 conn(0x7fa250066e60 msgr2=0x7fa250067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 -- 172.21.15.42:0/1918177320 shutdown_connections 2024-08-17T02:28:19.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.094+0000 7fa256400640 1 -- 172.21.15.42:0/1918177320 wait complete. 2024-08-17T02:28:19.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.095+0000 7fa256400640 1 Processor -- start 2024-08-17T02:28:19.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.096+0000 7fa256400640 1 -- start start 2024-08-17T02:28:19.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.096+0000 7fa256400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2500acf10 0x7fa2501550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.096+0000 7fa256400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa25016c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa256400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2501590b0 0x7fa250147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa256400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25016d5b0 con 0x7fa2500afca0 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa256400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500c5000 con 0x7fa2501590b0 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa256400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25016cff0 con 0x7fa2500acf10 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa25016c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa25016c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34012/0 (socket says 172.21.15.42:34012) 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 -- 172.21.15.42:0/2946719983 learned_addr learned my addr 172.21.15.42:0/2946719983 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24fe00640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2501590b0 0x7fa250147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 -- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2500acf10 msgr2=0x7fa2501550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24f400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2500acf10 0x7fa2501550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2500acf10 0x7fa2501550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 -- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2501590b0 msgr2=0x7fa250147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2501590b0 0x7fa250147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24ea00640 1 -- 172.21.15.42:0/2946719983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009390 con 0x7fa2500afca0 2024-08-17T02:28:19.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24fe00640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2501590b0 0x7fa250147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.097+0000 7fa24f400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2500acf10 0x7fa2501550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.098+0000 7fa24ea00640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa25016c680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c540 tx=0x7fa23c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.098+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c005aa0 con 0x7fa2500afca0 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.098+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c005c00 con 0x7fa2500afca0 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.098+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c0070f0 con 0x7fa2500afca0 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.098+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25016d2d0 con 0x7fa2500afca0 2024-08-17T02:28:19.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.098+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2501555f0 con 0x7fa2500afca0 2024-08-17T02:28:19.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.099+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa250063fb0 con 0x7fa2500afca0 2024-08-17T02:28:19.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.100+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa23c007520 con 0x7fa2500afca0 2024-08-17T02:28:19.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.101+0000 7fa246a00640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa230065220 0x7fa2300676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.101+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa23c081c20 con 0x7fa2500afca0 2024-08-17T02:28:19.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.101+0000 7fa24f400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa230065220 0x7fa2300676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.101+0000 7fa24f400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa230065220 0x7fa2300676d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa240034000 tx=0x7fa240032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.104+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa23c04fe40 con 0x7fa2500afca0 2024-08-17T02:28:19.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.324+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa25015a4e0 con 0x7fa2500afca0 2024-08-17T02:28:19.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.324+0000 7fa246a00640 1 -- 172.21.15.42:0/2946719983 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fa25015a4e0 con 0x7fa2500afca0 2024-08-17T02:28:19.325 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:19.325 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:15.308187+0000","modified":"2024-08-17T02:28:18.906436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4887},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4887":{"gid":4887,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6836/3869657839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3869657839},{"type":"v1","addr":"172.21.15.42:6836","nonce":3869657839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:19.325 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa230065220 msgr2=0x7fa2300676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa230065220 0x7fa2300676d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa240034000 tx=0x7fa240032000 comp rx=0 tx=0).stop 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 msgr2=0x7fa25016c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa25016c680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c540 tx=0x7fa23c00c940 comp rx=0 tx=0).stop 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 shutdown_connections 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa230065220 0x7fa2300676d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2501590b0 0x7fa250147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2500afca0 0x7fa25016c680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 --2- 172.21.15.42:0/2946719983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2500acf10 0x7fa2501550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.326+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 >> 172.21.15.42:0/2946719983 conn(0x7fa250066e60 msgr2=0x7fa2500c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.327+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 shutdown_connections 2024-08-17T02:28:19.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.327+0000 7fa256400640 1 -- 172.21.15.42:0/2946719983 wait complete. 2024-08-17T02:28:19.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.492+0000 7f27b9e00640 1 Processor -- start 2024-08-17T02:28:19.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.492+0000 7f27b9e00640 1 -- start start 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.493+0000 7f27b9e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f27b40afca0 0x7f27b40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.493+0000 7f27b9e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f27b41590b0 0x7f27b4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.493+0000 7f27b9e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b415a4e0 con 0x7f27b40acf10 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.493+0000 7f27b9e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b40b0980 con 0x7f27b41590b0 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.493+0000 7f27b9e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b40c92b0 con 0x7f27b40afca0 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b3400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f27b41590b0 0x7f27b4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b2000640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f27b40acf10 0x7f27b41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43834/0 (socket says 172.21.15.42:43834) 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b2000640 1 -- 172.21.15.42:0/27263954 learned_addr learned my addr 172.21.15.42:0/27263954 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:19.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b2a00640 1 --2- 172.21.15.42:0/27263954 >> v2:172.21.15.62:3300/0 conn(0x7f27b40afca0 0x7f27b40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b3400640 1 -- 172.21.15.42:0/27263954 >> v2:172.21.15.62:3300/0 conn(0x7f27b40afca0 msgr2=0x7f27b40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:19.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b3400640 1 --2- 172.21.15.42:0/27263954 >> v2:172.21.15.62:3300/0 conn(0x7f27b40afca0 0x7f27b40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b3400640 1 -- 172.21.15.42:0/27263954 >> v1:172.21.15.42:6789/0 conn(0x7f27b40acf10 legacy=0x7f27b41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b3400640 1 -- 172.21.15.42:0/27263954 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40ad480 con 0x7f27b41590b0 2024-08-17T02:28:19.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.494+0000 7f27b1600640 1 -- 172.21.15.42:0/27263954 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032942161 0 0) 0x7f27a0001110 con 0x7f27b40acf10 2024-08-17T02:28:19.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.495+0000 7f27b3400640 1 --2- 172.21.15.42:0/27263954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b41590b0 0x7f27b4159fa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27b4067e40 tx=0x7f27ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1aaf00914685fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.495+0000 7f27b1600640 1 -- 172.21.15.42:0/27263954 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007550 con 0x7f27b41590b0 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b1600640 1 -- 172.21.15.42:0/27263954 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac02d050 con 0x7f27b41590b0 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b1600640 1 -- 172.21.15.42:0/27263954 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0078e0 con 0x7f27b41590b0 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 -- 172.21.15.42:0/27263954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b41590b0 msgr2=0x7f27b4159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 --2- 172.21.15.42:0/27263954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b41590b0 0x7f27b4159fa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27b4067e40 tx=0x7f27ac009780 comp rx=0 tx=0).stop 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 -- 172.21.15.42:0/27263954 shutdown_connections 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 --2- 172.21.15.42:0/27263954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b41590b0 0x7f27b4159fa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 --2- 172.21.15.42:0/27263954 >> v2:172.21.15.62:3300/0 conn(0x7f27b40afca0 0x7f27b40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 -- 172.21.15.42:0/27263954 >> 172.21.15.42:0/27263954 conn(0x7f27b4066e60 msgr2=0x7f27b4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 -- 172.21.15.42:0/27263954 shutdown_connections 2024-08-17T02:28:19.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.496+0000 7f27b9e00640 1 -- 172.21.15.42:0/27263954 wait complete. 2024-08-17T02:28:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.498+0000 7f27b9e00640 1 Processor -- start 2024-08-17T02:28:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.498+0000 7f27b9e00640 1 -- start start 2024-08-17T02:28:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 0x7f27b414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b9e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b40afca0 0x7f27b414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b9e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b41590b0 0x7f27b4152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b9e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b414dfd0 con 0x7f27b40acf10 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b9e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b414a800 con 0x7f27b40afca0 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b9e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b415a790 con 0x7f27b41590b0 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 0x7f27b414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 0x7f27b414c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34032/0 (socket says 172.21.15.42:34032) 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 -- 172.21.15.42:0/3280363687 learned_addr learned my addr 172.21.15.42:0/3280363687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2000640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b40afca0 0x7f27b414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b3400640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b41590b0 0x7f27b4152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 -- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b41590b0 msgr2=0x7f27b4152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b41590b0 0x7f27b4152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 -- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b40afca0 msgr2=0x7f27b414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b40afca0 0x7f27b414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.499+0000 7f27b2a00640 1 -- 172.21.15.42:0/3280363687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac009a20 con 0x7f27b40acf10 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.500+0000 7f27b2a00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 0x7f27b414c090 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f27a400ea20 tx=0x7f27a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.500+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a400ca10 con 0x7f27b40acf10 2024-08-17T02:28:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.500+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a400cb70 con 0x7f27b40acf10 2024-08-17T02:28:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.500+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b415aa70 con 0x7f27b40acf10 2024-08-17T02:28:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.500+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a4013470 con 0x7f27b40acf10 2024-08-17T02:28:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.500+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b415b0b0 con 0x7f27b40acf10 2024-08-17T02:28:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.501+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b4063fb0 con 0x7f27b40acf10 2024-08-17T02:28:19.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.502+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f27a4013860 con 0x7f27b40acf10 2024-08-17T02:28:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.503+0000 7f27aa000640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2794065150 0x7f2794067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.503+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27a40827e0 con 0x7f27b40acf10 2024-08-17T02:28:19.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.503+0000 7f27b2000640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2794065150 0x7f2794067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.504+0000 7f27b2000640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2794065150 0x7f2794067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27b4070b80 tx=0x7f27a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.507+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f27a4050800 con 0x7f27b40acf10 2024-08-17T02:28:19.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.690+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27b4067b70 con 0x7f27b40acf10 2024-08-17T02:28:19.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.691+0000 7f27aa000640 1 -- 172.21.15.42:0/3280363687 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f27a4053e20 con 0x7f27b40acf10 2024-08-17T02:28:19.692 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:19.692 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:16.883837+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:19.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2794065150 msgr2=0x7f2794067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2794065150 0x7f2794067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f27b4070b80 tx=0x7f27a0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:19.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 msgr2=0x7f27b414c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 0x7f27b414c090 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f27a400ea20 tx=0x7f27a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 shutdown_connections 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2794065150 0x7f2794067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f27b41590b0 0x7f27b4152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27b40afca0 0x7f27b414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 --2- 172.21.15.42:0/3280363687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f27b40acf10 0x7f27b414c090 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 >> 172.21.15.42:0/3280363687 conn(0x7f27b4066e60 msgr2=0x7f27b4157480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 shutdown_connections 2024-08-17T02:28:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.694+0000 7f27b9e00640 1 -- 172.21.15.42:0/3280363687 wait complete. 2024-08-17T02:28:19.710 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:28:19.710 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:19.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:19.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.862+0000 7f152a800640 1 Processor -- start 2024-08-17T02:28:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.862+0000 7f152a800640 1 -- start start 2024-08-17T02:28:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f152a800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f152406e060 0x7f152406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f152a800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15240aeeb0 con 0x7f15240af340 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f152a800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152406e9f0 con 0x7f1524155040 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f152a800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240aadd0 con 0x7f152406e060 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f151aa00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f152406e060 0x7f152406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f1523e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f15240af340 0x7f15240af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43840/0 (socket says 172.21.15.42:43840) 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f1523e00640 1 -- 172.21.15.42:0/1779215287 learned_addr learned my addr 172.21.15.42:0/1779215287 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.863+0000 7f1523400640 1 --1- 172.21.15.42:0/1779215287 >> v1:172.21.15.62:6789/0 conn(0x7f1524155040 0x7f1524158c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:49248/0 (socket says 172.21.15.42:49248) 2024-08-17T02:28:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.864+0000 7f151aa00640 1 -- 172.21.15.42:0/1779215287 >> v1:172.21.15.62:6789/0 conn(0x7f1524155040 legacy=0x7f1524158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.864+0000 7f151aa00640 1 -- 172.21.15.42:0/1779215287 >> v1:172.21.15.42:6789/0 conn(0x7f15240af340 legacy=0x7f15240af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.864+0000 7f1522a00640 1 -- 172.21.15.42:0/1779215287 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674140666 0 0) 0x7f152406e9f0 con 0x7f1524155040 2024-08-17T02:28:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.864+0000 7f151aa00640 1 -- 172.21.15.42:0/1779215287 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15241597f0 con 0x7f152406e060 2024-08-17T02:28:19.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.865+0000 7f151aa00640 1 --2- 172.21.15.42:0/1779215287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f152406e060 0x7f152406e4b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f150c00a9f0 tx=0x7f150c00a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9124510889f92661 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.865+0000 7f1522a00640 1 -- 172.21.15.42:0/1779215287 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c033440 con 0x7f152406e060 2024-08-17T02:28:19.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.865+0000 7f1522a00640 1 -- 172.21.15.42:0/1779215287 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c0335a0 con 0x7f152406e060 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.865+0000 7f1522a00640 1 -- 172.21.15.42:0/1779215287 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c033940 con 0x7f152406e060 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 -- 172.21.15.42:0/1779215287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f152406e060 msgr2=0x7f152406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 --2- 172.21.15.42:0/1779215287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f152406e060 0x7f152406e4b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f150c00a9f0 tx=0x7f150c00a2b0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 -- 172.21.15.42:0/1779215287 shutdown_connections 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 --2- 172.21.15.42:0/1779215287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f152406e060 0x7f152406e4b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 -- 172.21.15.42:0/1779215287 >> 172.21.15.42:0/1779215287 conn(0x7f1524066e60 msgr2=0x7f1524067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 -- 172.21.15.42:0/1779215287 shutdown_connections 2024-08-17T02:28:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.866+0000 7f152a800640 1 -- 172.21.15.42:0/1779215287 wait complete. 2024-08-17T02:28:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.867+0000 7f152a800640 1 Processor -- start 2024-08-17T02:28:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.867+0000 7f152a800640 1 -- start start 2024-08-17T02:28:19.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.868+0000 7f152a800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f152406e060 0x7f15240c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.868+0000 7f152a800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15240af340 0x7f15241580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.868+0000 7f152a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 0x7f152406ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.868+0000 7f152a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524158ff0 con 0x7f1524155040 2024-08-17T02:28:19.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.868+0000 7f152a800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524158620 con 0x7f15240af340 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.868+0000 7f152a800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1524157c50 con 0x7f152406e060 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 0x7f152406ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f151aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15240af340 0x7f15241580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f152406e060 0x7f15240c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f151aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15240af340 0x7f15241580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:55918/0 (socket says 172.21.15.42:55918) 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f151aa00640 1 -- 172.21.15.42:0/1833701246 learned_addr learned my addr 172.21.15.42:0/1833701246 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 0x7f152406ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34046/0 (socket says 172.21.15.42:34046) 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 -- 172.21.15.42:0/1833701246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f152406e060 msgr2=0x7f15240c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f152406e060 0x7f15240c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 -- 172.21.15.42:0/1833701246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15240af340 msgr2=0x7f15241580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15240af340 0x7f15241580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.869+0000 7f1523e00640 1 -- 172.21.15.42:0/1833701246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c00a530 con 0x7f1524155040 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.870+0000 7f1523e00640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 0x7f152406ae10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f151c00cd80 tx=0x7f151c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.870+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00a850 con 0x7f1524155040 2024-08-17T02:28:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.870+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00a9b0 con 0x7f1524155040 2024-08-17T02:28:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.870+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00ad70 con 0x7f1524155040 2024-08-17T02:28:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.870+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1524169b50 con 0x7f1524155040 2024-08-17T02:28:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.870+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1524157600 con 0x7f1524155040 2024-08-17T02:28:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.871+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15240cb2d0 con 0x7f1524155040 2024-08-17T02:28:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.872+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f151c007300 con 0x7f1524155040 2024-08-17T02:28:19.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.873+0000 7f151b400640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1500065220 0x7f15000676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.873+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f151c0824a0 con 0x7f1524155040 2024-08-17T02:28:19.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.873+0000 7f1523400640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1500065220 0x7f15000676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.873+0000 7f1523400640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1500065220 0x7f15000676d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15240ab620 tx=0x7f1514007e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:19.877+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f151c0506e0 con 0x7f1524155040 2024-08-17T02:28:20.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.057+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1524157dc0 con 0x7f1500065220 2024-08-17T02:28:20.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.065+0000 7f151b400640 1 -- 172.21.15.42:0/1833701246 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264654 (secure 0 0 0) 0x7f1524157dc0 con 0x7f1500065220 2024-08-17T02:28:20.069 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:28:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1500065220 msgr2=0x7f15000676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1500065220 0x7f15000676d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15240ab620 tx=0x7f1514007e60 comp rx=0 tx=0).stop 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 msgr2=0x7f152406ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 0x7f152406ae10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f151c00cd80 tx=0x7f151c001b00 comp rx=0 tx=0).stop 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 shutdown_connections 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1500065220 0x7f15000676d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1524155040 0x7f152406ae10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15240af340 0x7f15241580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 --2- 172.21.15.42:0/1833701246 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f152406e060 0x7f15240c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 >> 172.21.15.42:0/1833701246 conn(0x7f1524066e60 msgr2=0x7f15240a9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 shutdown_connections 2024-08-17T02:28:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.069+0000 7f152a800640 1 -- 172.21.15.42:0/1833701246 wait complete. 2024-08-17T02:28:20.085 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:28:19.193029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399536,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575184,"statfs":{"total":773094113280,"available":770636988416,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.323981"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.912669+0000","last_change":"2024-08-17T02:28:15.907170+0000","last_active":"2024-08-17T02:28:15.912669+0000","last_peered":"2024-08-17T02:28:15.912669+0000","last_clean":"2024-08-17T02:28:15.912669+0000","last_became_active":"2024-08-17T02:28:15.906926+0000","last_became_peered":"2024-08-17T02:28:15.906926+0000","last_unstale":"2024-08-17T02:28:15.912669+0000","last_undegraded":"2024-08-17T02:28:15.912669+0000","last_fullsized":"2024-08-17T02:28:15.912669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:34.267452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926183+0000","last_change":"2024-08-17T02:28:15.915399+0000","last_active":"2024-08-17T02:28:15.926183+0000","last_peered":"2024-08-17T02:28:15.926183+0000","last_clean":"2024-08-17T02:28:15.926183+0000","last_became_active":"2024-08-17T02:28:15.913082+0000","last_became_peered":"2024-08-17T02:28:15.913082+0000","last_unstale":"2024-08-17T02:28:15.926183+0000","last_undegraded":"2024-08-17T02:28:15.926183+0000","last_fullsized":"2024-08-17T02:28:15.926183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:04.378229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923676+0000","last_change":"2024-08-17T02:28:15.918534+0000","last_active":"2024-08-17T02:28:15.923676+0000","last_peered":"2024-08-17T02:28:15.923676+0000","last_clean":"2024-08-17T02:28:15.923676+0000","last_became_active":"2024-08-17T02:28:15.918212+0000","last_became_peered":"2024-08-17T02:28:15.918212+0000","last_unstale":"2024-08-17T02:28:15.923676+0000","last_undegraded":"2024-08-17T02:28:15.923676+0000","last_fullsized":"2024-08-17T02:28:15.923676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:40.151747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927275+0000","last_change":"2024-08-17T02:28:15.920605+0000","last_active":"2024-08-17T02:28:15.927275+0000","last_peered":"2024-08-17T02:28:15.927275+0000","last_clean":"2024-08-17T02:28:15.927275+0000","last_became_active":"2024-08-17T02:28:15.920316+0000","last_became_peered":"2024-08-17T02:28:15.920316+0000","last_unstale":"2024-08-17T02:28:15.927275+0000","last_undegraded":"2024-08-17T02:28:15.927275+0000","last_fullsized":"2024-08-17T02:28:15.927275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:05.262035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906579+0000","last_change":"2024-08-17T02:28:15.898871+0000","last_active":"2024-08-17T02:28:15.906579+0000","last_peered":"2024-08-17T02:28:15.906579+0000","last_clean":"2024-08-17T02:28:15.906579+0000","last_became_active":"2024-08-17T02:28:15.898575+0000","last_became_peered":"2024-08-17T02:28:15.898575+0000","last_unstale":"2024-08-17T02:28:15.906579+0000","last_undegraded":"2024-08-17T02:28:15.906579+0000","last_fullsized":"2024-08-17T02:28:15.906579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:18.434123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927457+0000","last_change":"2024-08-17T02:28:15.920704+0000","last_active":"2024-08-17T02:28:15.927457+0000","last_peered":"2024-08-17T02:28:15.927457+0000","last_clean":"2024-08-17T02:28:15.927457+0000","last_became_active":"2024-08-17T02:28:15.915109+0000","last_became_peered":"2024-08-17T02:28:15.915109+0000","last_unstale":"2024-08-17T02:28:15.927457+0000","last_undegraded":"2024-08-17T02:28:15.927457+0000","last_fullsized":"2024-08-17T02:28:15.927457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:51.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.909218+0000","last_change":"2024-08-17T02:28:15.906824+0000","last_active":"2024-08-17T02:28:15.909218+0000","last_peered":"2024-08-17T02:28:15.909218+0000","last_clean":"2024-08-17T02:28:15.909218+0000","last_became_active":"2024-08-17T02:28:15.906592+0000","last_became_peered":"2024-08-17T02:28:15.906592+0000","last_unstale":"2024-08-17T02:28:15.909218+0000","last_undegraded":"2024-08-17T02:28:15.909218+0000","last_fullsized":"2024-08-17T02:28:15.909218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:13.979813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.915261+0000","last_change":"2024-08-17T02:28:15.908734+0000","last_active":"2024-08-17T02:28:15.915261+0000","last_peered":"2024-08-17T02:28:15.915261+0000","last_clean":"2024-08-17T02:28:15.915261+0000","last_became_active":"2024-08-17T02:28:15.906181+0000","last_became_peered":"2024-08-17T02:28:15.906181+0000","last_unstale":"2024-08-17T02:28:15.915261+0000","last_undegraded":"2024-08-17T02:28:15.915261+0000","last_fullsized":"2024-08-17T02:28:15.915261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:20.478251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928212+0000","last_change":"2024-08-17T02:28:15.921738+0000","last_active":"2024-08-17T02:28:15.928212+0000","last_peered":"2024-08-17T02:28:15.928212+0000","last_clean":"2024-08-17T02:28:15.928212+0000","last_became_active":"2024-08-17T02:28:15.921417+0000","last_became_peered":"2024-08-17T02:28:15.921417+0000","last_unstale":"2024-08-17T02:28:15.928212+0000","last_undegraded":"2024-08-17T02:28:15.928212+0000","last_fullsized":"2024-08-17T02:28:15.928212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:34:49.675780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927872+0000","last_change":"2024-08-17T02:28:15.921486+0000","last_active":"2024-08-17T02:28:15.927872+0000","last_peered":"2024-08-17T02:28:15.927872+0000","last_clean":"2024-08-17T02:28:15.927872+0000","last_became_active":"2024-08-17T02:28:15.921011+0000","last_became_peered":"2024-08-17T02:28:15.921011+0000","last_unstale":"2024-08-17T02:28:15.927872+0000","last_undegraded":"2024-08-17T02:28:15.927872+0000","last_fullsized":"2024-08-17T02:28:15.927872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:32.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924277+0000","last_change":"2024-08-17T02:28:15.917515+0000","last_active":"2024-08-17T02:28:15.924277+0000","last_peered":"2024-08-17T02:28:15.924277+0000","last_clean":"2024-08-17T02:28:15.924277+0000","last_became_active":"2024-08-17T02:28:15.917213+0000","last_became_peered":"2024-08-17T02:28:15.917213+0000","last_unstale":"2024-08-17T02:28:15.924277+0000","last_undegraded":"2024-08-17T02:28:15.924277+0000","last_fullsized":"2024-08-17T02:28:15.924277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:50.209582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.904970+0000","last_change":"2024-08-17T02:28:15.902221+0000","last_active":"2024-08-17T02:28:15.904970+0000","last_peered":"2024-08-17T02:28:15.904970+0000","last_clean":"2024-08-17T02:28:15.904970+0000","last_became_active":"2024-08-17T02:28:15.901917+0000","last_became_peered":"2024-08-17T02:28:15.901917+0000","last_unstale":"2024-08-17T02:28:15.904970+0000","last_undegraded":"2024-08-17T02:28:15.904970+0000","last_fullsized":"2024-08-17T02:28:15.904970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:27.093404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906603+0000","last_change":"2024-08-17T02:28:15.898651+0000","last_active":"2024-08-17T02:28:15.906603+0000","last_peered":"2024-08-17T02:28:15.906603+0000","last_clean":"2024-08-17T02:28:15.906603+0000","last_became_active":"2024-08-17T02:28:15.898300+0000","last_became_peered":"2024-08-17T02:28:15.898300+0000","last_unstale":"2024-08-17T02:28:15.906603+0000","last_undegraded":"2024-08-17T02:28:15.906603+0000","last_fullsized":"2024-08-17T02:28:15.906603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:19.404375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927480+0000","last_change":"2024-08-17T02:28:15.920856+0000","last_active":"2024-08-17T02:28:15.927480+0000","last_peered":"2024-08-17T02:28:15.927480+0000","last_clean":"2024-08-17T02:28:15.927480+0000","last_became_active":"2024-08-17T02:28:15.920426+0000","last_became_peered":"2024-08-17T02:28:15.920426+0000","last_unstale":"2024-08-17T02:28:15.927480+0000","last_undegraded":"2024-08-17T02:28:15.927480+0000","last_fullsized":"2024-08-17T02:28:15.927480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:16.624145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905751+0000","last_change":"2024-08-17T02:28:15.902971+0000","last_active":"2024-08-17T02:28:15.905751+0000","last_peered":"2024-08-17T02:28:15.905751+0000","last_clean":"2024-08-17T02:28:15.905751+0000","last_became_active":"2024-08-17T02:28:15.902754+0000","last_became_peered":"2024-08-17T02:28:15.902754+0000","last_unstale":"2024-08-17T02:28:15.905751+0000","last_undegraded":"2024-08-17T02:28:15.905751+0000","last_fullsized":"2024-08-17T02:28:15.905751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:51.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921000+0000","last_change":"2024-08-17T02:28:15.911336+0000","last_active":"2024-08-17T02:28:15.921000+0000","last_peered":"2024-08-17T02:28:15.921000+0000","last_clean":"2024-08-17T02:28:15.921000+0000","last_became_active":"2024-08-17T02:28:15.911006+0000","last_became_peered":"2024-08-17T02:28:15.911006+0000","last_unstale":"2024-08-17T02:28:15.921000+0000","last_undegraded":"2024-08-17T02:28:15.921000+0000","last_fullsized":"2024-08-17T02:28:15.921000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:51.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920617+0000","last_change":"2024-08-17T02:28:15.909300+0000","last_active":"2024-08-17T02:28:15.920617+0000","last_peered":"2024-08-17T02:28:15.920617+0000","last_clean":"2024-08-17T02:28:15.920617+0000","last_became_active":"2024-08-17T02:28:15.908987+0000","last_became_peered":"2024-08-17T02:28:15.908987+0000","last_unstale":"2024-08-17T02:28:15.920617+0000","last_undegraded":"2024-08-17T02:28:15.920617+0000","last_fullsized":"2024-08-17T02:28:15.920617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:16.624145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926203+0000","last_change":"2024-08-17T02:28:15.915639+0000","last_active":"2024-08-17T02:28:15.926203+0000","last_peered":"2024-08-17T02:28:15.926203+0000","last_clean":"2024-08-17T02:28:15.926203+0000","last_became_active":"2024-08-17T02:28:15.915013+0000","last_became_peered":"2024-08-17T02:28:15.915013+0000","last_unstale":"2024-08-17T02:28:15.926203+0000","last_undegraded":"2024-08-17T02:28:15.926203+0000","last_fullsized":"2024-08-17T02:28:15.926203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:40.151747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927538+0000","last_change":"2024-08-17T02:28:15.921183+0000","last_active":"2024-08-17T02:28:15.927538+0000","last_peered":"2024-08-17T02:28:15.927538+0000","last_clean":"2024-08-17T02:28:15.927538+0000","last_became_active":"2024-08-17T02:28:15.920547+0000","last_became_peered":"2024-08-17T02:28:15.920547+0000","last_unstale":"2024-08-17T02:28:15.927538+0000","last_undegraded":"2024-08-17T02:28:15.927538+0000","last_fullsized":"2024-08-17T02:28:15.927538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:08.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.908049+0000","last_change":"2024-08-17T02:28:15.906172+0000","last_active":"2024-08-17T02:28:15.908049+0000","last_peered":"2024-08-17T02:28:15.908049+0000","last_clean":"2024-08-17T02:28:15.908049+0000","last_became_active":"2024-08-17T02:28:15.905884+0000","last_became_peered":"2024-08-17T02:28:15.905884+0000","last_unstale":"2024-08-17T02:28:15.908049+0000","last_undegraded":"2024-08-17T02:28:15.908049+0000","last_fullsized":"2024-08-17T02:28:15.908049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:27.114597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924216+0000","last_change":"2024-08-17T02:28:15.917485+0000","last_active":"2024-08-17T02:28:15.924216+0000","last_peered":"2024-08-17T02:28:15.924216+0000","last_clean":"2024-08-17T02:28:15.924216+0000","last_became_active":"2024-08-17T02:28:15.917241+0000","last_became_peered":"2024-08-17T02:28:15.917241+0000","last_unstale":"2024-08-17T02:28:15.924216+0000","last_undegraded":"2024-08-17T02:28:15.924216+0000","last_fullsized":"2024-08-17T02:28:15.924216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:50.653016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916934+0000","last_change":"2024-08-17T02:28:15.909792+0000","last_active":"2024-08-17T02:28:15.916934+0000","last_peered":"2024-08-17T02:28:15.916934+0000","last_clean":"2024-08-17T02:28:15.916934+0000","last_became_active":"2024-08-17T02:28:15.909315+0000","last_became_peered":"2024-08-17T02:28:15.909315+0000","last_unstale":"2024-08-17T02:28:15.916934+0000","last_undegraded":"2024-08-17T02:28:15.916934+0000","last_fullsized":"2024-08-17T02:28:15.916934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:05.262035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916450+0000","last_change":"2024-08-17T02:28:15.897683+0000","last_active":"2024-08-17T02:28:15.916450+0000","last_peered":"2024-08-17T02:28:15.916450+0000","last_clean":"2024-08-17T02:28:15.916450+0000","last_became_active":"2024-08-17T02:28:15.897355+0000","last_became_peered":"2024-08-17T02:28:15.897355+0000","last_unstale":"2024-08-17T02:28:15.916450+0000","last_undegraded":"2024-08-17T02:28:15.916450+0000","last_fullsized":"2024-08-17T02:28:15.916450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:34:49.675780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.915986+0000","last_change":"2024-08-17T02:28:15.908272+0000","last_active":"2024-08-17T02:28:15.915986+0000","last_peered":"2024-08-17T02:28:15.915986+0000","last_clean":"2024-08-17T02:28:15.915986+0000","last_became_active":"2024-08-17T02:28:15.907768+0000","last_became_peered":"2024-08-17T02:28:15.907768+0000","last_unstale":"2024-08-17T02:28:15.915986+0000","last_undegraded":"2024-08-17T02:28:15.915986+0000","last_fullsized":"2024-08-17T02:28:15.915986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:16.624145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.919186+0000","last_change":"2024-08-17T02:28:15.914555+0000","last_active":"2024-08-17T02:28:15.919186+0000","last_peered":"2024-08-17T02:28:15.919186+0000","last_clean":"2024-08-17T02:28:15.919186+0000","last_became_active":"2024-08-17T02:28:15.914136+0000","last_became_peered":"2024-08-17T02:28:15.914136+0000","last_unstale":"2024-08-17T02:28:15.919186+0000","last_undegraded":"2024-08-17T02:28:15.919186+0000","last_fullsized":"2024-08-17T02:28:15.919186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:13.979813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926220+0000","last_change":"2024-08-17T02:28:15.916327+0000","last_active":"2024-08-17T02:28:15.926220+0000","last_peered":"2024-08-17T02:28:15.926220+0000","last_clean":"2024-08-17T02:28:15.926220+0000","last_became_active":"2024-08-17T02:28:15.916070+0000","last_became_peered":"2024-08-17T02:28:15.916070+0000","last_unstale":"2024-08-17T02:28:15.926220+0000","last_undegraded":"2024-08-17T02:28:15.926220+0000","last_fullsized":"2024-08-17T02:28:15.926220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:02.574091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923810+0000","last_change":"2024-08-17T02:28:15.917922+0000","last_active":"2024-08-17T02:28:15.923810+0000","last_peered":"2024-08-17T02:28:15.923810+0000","last_clean":"2024-08-17T02:28:15.923810+0000","last_became_active":"2024-08-17T02:28:15.917680+0000","last_became_peered":"2024-08-17T02:28:15.917680+0000","last_unstale":"2024-08-17T02:28:15.923810+0000","last_undegraded":"2024-08-17T02:28:15.923810+0000","last_fullsized":"2024-08-17T02:28:15.923810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:30.685480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.904951+0000","last_change":"2024-08-17T02:28:15.899923+0000","last_active":"2024-08-17T02:28:15.904951+0000","last_peered":"2024-08-17T02:28:15.904951+0000","last_clean":"2024-08-17T02:28:15.904951+0000","last_became_active":"2024-08-17T02:28:15.899621+0000","last_became_peered":"2024-08-17T02:28:15.899621+0000","last_unstale":"2024-08-17T02:28:15.904951+0000","last_undegraded":"2024-08-17T02:28:15.904951+0000","last_fullsized":"2024-08-17T02:28:15.904951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:02.574091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928463+0000","last_change":"2024-08-17T02:28:15.922554+0000","last_active":"2024-08-17T02:28:15.928463+0000","last_peered":"2024-08-17T02:28:15.928463+0000","last_clean":"2024-08-17T02:28:15.928463+0000","last_became_active":"2024-08-17T02:28:15.922241+0000","last_became_peered":"2024-08-17T02:28:15.922241+0000","last_unstale":"2024-08-17T02:28:15.928463+0000","last_undegraded":"2024-08-17T02:28:15.928463+0000","last_fullsized":"2024-08-17T02:28:15.928463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:37.364500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920657+0000","last_change":"2024-08-17T02:28:15.909483+0000","last_active":"2024-08-17T02:28:15.920657+0000","last_peered":"2024-08-17T02:28:15.920657+0000","last_clean":"2024-08-17T02:28:15.920657+0000","last_became_active":"2024-08-17T02:28:15.908979+0000","last_became_peered":"2024-08-17T02:28:15.908979+0000","last_unstale":"2024-08-17T02:28:15.920657+0000","last_undegraded":"2024-08-17T02:28:15.920657+0000","last_fullsized":"2024-08-17T02:28:15.920657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:27.093404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.908052+0000","last_change":"2024-08-17T02:28:15.903250+0000","last_active":"2024-08-17T02:28:15.908052+0000","last_peered":"2024-08-17T02:28:15.908052+0000","last_clean":"2024-08-17T02:28:15.908052+0000","last_became_active":"2024-08-17T02:28:15.902944+0000","last_became_peered":"2024-08-17T02:28:15.902944+0000","last_unstale":"2024-08-17T02:28:15.908052+0000","last_undegraded":"2024-08-17T02:28:15.908052+0000","last_fullsized":"2024-08-17T02:28:15.908052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:50.653016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921053+0000","last_change":"2024-08-17T02:28:15.913493+0000","last_active":"2024-08-17T02:28:15.921053+0000","last_peered":"2024-08-17T02:28:15.921053+0000","last_clean":"2024-08-17T02:28:15.921053+0000","last_became_active":"2024-08-17T02:28:15.912993+0000","last_became_peered":"2024-08-17T02:28:15.912993+0000","last_unstale":"2024-08-17T02:28:15.921053+0000","last_undegraded":"2024-08-17T02:28:15.921053+0000","last_fullsized":"2024-08-17T02:28:15.921053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:02.574091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.918215+0000","last_change":"2024-08-17T02:28:15.906972+0000","last_active":"2024-08-17T02:28:15.918215+0000","last_peered":"2024-08-17T02:28:15.918215+0000","last_clean":"2024-08-17T02:28:15.918215+0000","last_became_active":"2024-08-17T02:28:15.905751+0000","last_became_peered":"2024-08-17T02:28:15.905751+0000","last_unstale":"2024-08-17T02:28:15.918215+0000","last_undegraded":"2024-08-17T02:28:15.918215+0000","last_fullsized":"2024-08-17T02:28:15.918215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:12.965709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924380+0000","last_change":"2024-08-17T02:28:14.897309+0000","last_active":"2024-08-17T02:28:15.924380+0000","last_peered":"2024-08-17T02:28:15.924380+0000","last_clean":"2024-08-17T02:28:15.924380+0000","last_became_active":"2024-08-17T02:28:14.894924+0000","last_became_peered":"2024-08-17T02:28:14.894924+0000","last_unstale":"2024-08-17T02:28:15.924380+0000","last_undegraded":"2024-08-17T02:28:15.924380+0000","last_fullsized":"2024-08-17T02:28:15.924380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.789464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920285+0000","last_change":"2024-08-17T02:28:15.912768+0000","last_active":"2024-08-17T02:28:15.920285+0000","last_peered":"2024-08-17T02:28:15.920285+0000","last_clean":"2024-08-17T02:28:15.920285+0000","last_became_active":"2024-08-17T02:28:15.911006+0000","last_became_peered":"2024-08-17T02:28:15.911006+0000","last_unstale":"2024-08-17T02:28:15.920285+0000","last_undegraded":"2024-08-17T02:28:15.920285+0000","last_fullsized":"2024-08-17T02:28:15.920285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:05.697487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928638+0000","last_change":"2024-08-17T02:28:14.901732+0000","last_active":"2024-08-17T02:28:15.928638+0000","last_peered":"2024-08-17T02:28:15.928638+0000","last_clean":"2024-08-17T02:28:15.928638+0000","last_became_active":"2024-08-17T02:28:14.901411+0000","last_became_peered":"2024-08-17T02:28:14.901411+0000","last_unstale":"2024-08-17T02:28:15.928638+0000","last_undegraded":"2024-08-17T02:28:15.928638+0000","last_fullsized":"2024-08-17T02:28:15.928638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:40.720695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916631+0000","last_change":"2024-08-17T02:28:15.911097+0000","last_active":"2024-08-17T02:28:15.916631+0000","last_peered":"2024-08-17T02:28:15.916631+0000","last_clean":"2024-08-17T02:28:15.916631+0000","last_became_active":"2024-08-17T02:28:15.910832+0000","last_became_peered":"2024-08-17T02:28:15.910832+0000","last_unstale":"2024-08-17T02:28:15.916631+0000","last_undegraded":"2024-08-17T02:28:15.916631+0000","last_fullsized":"2024-08-17T02:28:15.916631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:12.965709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928851+0000","last_change":"2024-08-17T02:28:14.901047+0000","last_active":"2024-08-17T02:28:15.928851+0000","last_peered":"2024-08-17T02:28:15.928851+0000","last_clean":"2024-08-17T02:28:15.928851+0000","last_became_active":"2024-08-17T02:28:14.900768+0000","last_became_peered":"2024-08-17T02:28:14.900768+0000","last_unstale":"2024-08-17T02:28:15.928851+0000","last_undegraded":"2024-08-17T02:28:15.928851+0000","last_fullsized":"2024-08-17T02:28:15.928851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:06.989586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923791+0000","last_change":"2024-08-17T02:28:15.917869+0000","last_active":"2024-08-17T02:28:15.923791+0000","last_peered":"2024-08-17T02:28:15.923791+0000","last_clean":"2024-08-17T02:28:15.923791+0000","last_became_active":"2024-08-17T02:28:15.917317+0000","last_became_peered":"2024-08-17T02:28:15.917317+0000","last_unstale":"2024-08-17T02:28:15.923791+0000","last_undegraded":"2024-08-17T02:28:15.923791+0000","last_fullsized":"2024-08-17T02:28:15.923791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:34:49.675780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924506+0000","last_change":"2024-08-17T02:28:14.895695+0000","last_active":"2024-08-17T02:28:15.924506+0000","last_peered":"2024-08-17T02:28:15.924506+0000","last_clean":"2024-08-17T02:28:15.924506+0000","last_became_active":"2024-08-17T02:28:14.895322+0000","last_became_peered":"2024-08-17T02:28:14.895322+0000","last_unstale":"2024-08-17T02:28:15.924506+0000","last_undegraded":"2024-08-17T02:28:15.924506+0000","last_fullsized":"2024-08-17T02:28:15.924506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:16.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920679+0000","last_change":"2024-08-17T02:28:15.912138+0000","last_active":"2024-08-17T02:28:15.920679+0000","last_peered":"2024-08-17T02:28:15.920679+0000","last_clean":"2024-08-17T02:28:15.920679+0000","last_became_active":"2024-08-17T02:28:15.911860+0000","last_became_peered":"2024-08-17T02:28:15.911860+0000","last_unstale":"2024-08-17T02:28:15.920679+0000","last_undegraded":"2024-08-17T02:28:15.920679+0000","last_fullsized":"2024-08-17T02:28:15.920679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:08.593518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929488+0000","last_change":"2024-08-17T02:28:14.888946+0000","last_active":"2024-08-17T02:28:15.929488+0000","last_peered":"2024-08-17T02:28:15.929488+0000","last_clean":"2024-08-17T02:28:15.929488+0000","last_became_active":"2024-08-17T02:28:14.888666+0000","last_became_peered":"2024-08-17T02:28:14.888666+0000","last_unstale":"2024-08-17T02:28:15.929488+0000","last_undegraded":"2024-08-17T02:28:15.929488+0000","last_fullsized":"2024-08-17T02:28:15.929488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:17.427818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.913086+0000","last_change":"2024-08-17T02:28:15.907635+0000","last_active":"2024-08-17T02:28:15.913086+0000","last_peered":"2024-08-17T02:28:15.913086+0000","last_clean":"2024-08-17T02:28:15.913086+0000","last_became_active":"2024-08-17T02:28:15.906829+0000","last_became_peered":"2024-08-17T02:28:15.906829+0000","last_unstale":"2024-08-17T02:28:15.913086+0000","last_undegraded":"2024-08-17T02:28:15.913086+0000","last_fullsized":"2024-08-17T02:28:15.913086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:04.378229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928947+0000","last_change":"2024-08-17T02:28:14.889015+0000","last_active":"2024-08-17T02:28:15.928947+0000","last_peered":"2024-08-17T02:28:15.928947+0000","last_clean":"2024-08-17T02:28:15.928947+0000","last_became_active":"2024-08-17T02:28:14.888742+0000","last_became_peered":"2024-08-17T02:28:14.888742+0000","last_unstale":"2024-08-17T02:28:15.928947+0000","last_undegraded":"2024-08-17T02:28:15.928947+0000","last_fullsized":"2024-08-17T02:28:15.928947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:19.512922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916439+0000","last_change":"2024-08-17T02:28:15.909765+0000","last_active":"2024-08-17T02:28:15.916439+0000","last_peered":"2024-08-17T02:28:15.916439+0000","last_clean":"2024-08-17T02:28:15.916439+0000","last_became_active":"2024-08-17T02:28:15.909447+0000","last_became_peered":"2024-08-17T02:28:15.909447+0000","last_unstale":"2024-08-17T02:28:15.916439+0000","last_undegraded":"2024-08-17T02:28:15.916439+0000","last_fullsized":"2024-08-17T02:28:15.916439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:09.415021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890861+0000","last_change":"2024-08-17T02:28:14.895225+0000","last_active":"2024-08-17T02:28:15.890861+0000","last_peered":"2024-08-17T02:28:15.890861+0000","last_clean":"2024-08-17T02:28:15.890861+0000","last_became_active":"2024-08-17T02:28:14.894907+0000","last_became_peered":"2024-08-17T02:28:14.894907+0000","last_unstale":"2024-08-17T02:28:15.890861+0000","last_undegraded":"2024-08-17T02:28:15.890861+0000","last_fullsized":"2024-08-17T02:28:15.890861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:40.720695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.907569+0000","last_change":"2024-08-17T02:28:15.900609+0000","last_active":"2024-08-17T02:28:15.907569+0000","last_peered":"2024-08-17T02:28:15.907569+0000","last_clean":"2024-08-17T02:28:15.907569+0000","last_became_active":"2024-08-17T02:28:15.900333+0000","last_became_peered":"2024-08-17T02:28:15.900333+0000","last_unstale":"2024-08-17T02:28:15.907569+0000","last_undegraded":"2024-08-17T02:28:15.907569+0000","last_fullsized":"2024-08-17T02:28:15.907569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:50.209582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.904586+0000","last_change":"2024-08-17T02:28:14.888083+0000","last_active":"2024-08-17T02:28:15.904586+0000","last_peered":"2024-08-17T02:28:15.904586+0000","last_clean":"2024-08-17T02:28:15.904586+0000","last_became_active":"2024-08-17T02:28:14.887738+0000","last_became_peered":"2024-08-17T02:28:14.887738+0000","last_unstale":"2024-08-17T02:28:15.904586+0000","last_undegraded":"2024-08-17T02:28:15.904586+0000","last_fullsized":"2024-08-17T02:28:15.904586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:55.664371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923288+0000","last_change":"2024-08-17T02:28:15.919197+0000","last_active":"2024-08-17T02:28:15.923288+0000","last_peered":"2024-08-17T02:28:15.923288+0000","last_clean":"2024-08-17T02:28:15.923288+0000","last_became_active":"2024-08-17T02:28:15.918200+0000","last_became_peered":"2024-08-17T02:28:15.918200+0000","last_unstale":"2024-08-17T02:28:15.923288+0000","last_undegraded":"2024-08-17T02:28:15.923288+0000","last_fullsized":"2024-08-17T02:28:15.923288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:08.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.892665+0000","last_change":"2024-08-17T02:28:14.900083+0000","last_active":"2024-08-17T02:28:15.892665+0000","last_peered":"2024-08-17T02:28:15.892665+0000","last_clean":"2024-08-17T02:28:15.892665+0000","last_became_active":"2024-08-17T02:28:14.899726+0000","last_became_peered":"2024-08-17T02:28:14.899726+0000","last_unstale":"2024-08-17T02:28:15.892665+0000","last_undegraded":"2024-08-17T02:28:15.892665+0000","last_fullsized":"2024-08-17T02:28:15.892665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:33.261147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906543+0000","last_change":"2024-08-17T02:28:15.902203+0000","last_active":"2024-08-17T02:28:15.906543+0000","last_peered":"2024-08-17T02:28:15.906543+0000","last_clean":"2024-08-17T02:28:15.906543+0000","last_became_active":"2024-08-17T02:28:15.901896+0000","last_became_peered":"2024-08-17T02:28:15.901896+0000","last_unstale":"2024-08-17T02:28:15.906543+0000","last_undegraded":"2024-08-17T02:28:15.906543+0000","last_fullsized":"2024-08-17T02:28:15.906543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:21.159860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.886982+0000","last_change":"2024-08-17T02:28:14.902315+0000","last_active":"2024-08-17T02:28:15.886982+0000","last_peered":"2024-08-17T02:28:15.886982+0000","last_clean":"2024-08-17T02:28:15.886982+0000","last_became_active":"2024-08-17T02:28:14.901379+0000","last_became_peered":"2024-08-17T02:28:14.901379+0000","last_unstale":"2024-08-17T02:28:15.886982+0000","last_undegraded":"2024-08-17T02:28:15.886982+0000","last_fullsized":"2024-08-17T02:28:15.886982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:55.825420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928523+0000","last_change":"2024-08-17T02:28:15.924721+0000","last_active":"2024-08-17T02:28:15.928523+0000","last_peered":"2024-08-17T02:28:15.928523+0000","last_clean":"2024-08-17T02:28:15.928523+0000","last_became_active":"2024-08-17T02:28:15.916201+0000","last_became_peered":"2024-08-17T02:28:15.916201+0000","last_unstale":"2024-08-17T02:28:15.928523+0000","last_undegraded":"2024-08-17T02:28:15.928523+0000","last_fullsized":"2024-08-17T02:28:15.928523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:27.093404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926153+0000","last_change":"2024-08-17T02:28:14.900061+0000","last_active":"2024-08-17T02:28:15.926153+0000","last_peered":"2024-08-17T02:28:15.926153+0000","last_clean":"2024-08-17T02:28:15.926153+0000","last_became_active":"2024-08-17T02:28:14.899756+0000","last_became_peered":"2024-08-17T02:28:14.899756+0000","last_unstale":"2024-08-17T02:28:15.926153+0000","last_undegraded":"2024-08-17T02:28:15.926153+0000","last_fullsized":"2024-08-17T02:28:15.926153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:09.321766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.925552+0000","last_change":"2024-08-17T02:28:15.921239+0000","last_active":"2024-08-17T02:28:15.925552+0000","last_peered":"2024-08-17T02:28:15.925552+0000","last_clean":"2024-08-17T02:28:15.925552+0000","last_became_active":"2024-08-17T02:28:15.920907+0000","last_became_peered":"2024-08-17T02:28:15.920907+0000","last_unstale":"2024-08-17T02:28:15.925552+0000","last_undegraded":"2024-08-17T02:28:15.925552+0000","last_fullsized":"2024-08-17T02:28:15.925552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:30.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.931975+0000","last_change":"2024-08-17T02:28:14.901651+0000","last_active":"2024-08-17T02:28:15.931975+0000","last_peered":"2024-08-17T02:28:15.931975+0000","last_clean":"2024-08-17T02:28:15.931975+0000","last_became_active":"2024-08-17T02:28:14.901383+0000","last_became_peered":"2024-08-17T02:28:14.901383+0000","last_unstale":"2024-08-17T02:28:15.931975+0000","last_undegraded":"2024-08-17T02:28:15.931975+0000","last_fullsized":"2024-08-17T02:28:15.931975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:26.903646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906834+0000","last_change":"2024-08-17T02:28:15.901682+0000","last_active":"2024-08-17T02:28:15.906834+0000","last_peered":"2024-08-17T02:28:15.906834+0000","last_clean":"2024-08-17T02:28:15.906834+0000","last_became_active":"2024-08-17T02:28:15.901417+0000","last_became_peered":"2024-08-17T02:28:15.901417+0000","last_unstale":"2024-08-17T02:28:15.906834+0000","last_undegraded":"2024-08-17T02:28:15.906834+0000","last_fullsized":"2024-08-17T02:28:15.906834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:13.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929613+0000","last_change":"2024-08-17T02:28:14.888851+0000","last_active":"2024-08-17T02:28:15.929613+0000","last_peered":"2024-08-17T02:28:15.929613+0000","last_clean":"2024-08-17T02:28:15.929613+0000","last_became_active":"2024-08-17T02:28:14.888006+0000","last_became_peered":"2024-08-17T02:28:14.888006+0000","last_unstale":"2024-08-17T02:28:15.929613+0000","last_undegraded":"2024-08-17T02:28:15.929613+0000","last_fullsized":"2024-08-17T02:28:15.929613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:14:08.476080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927821+0000","last_change":"2024-08-17T02:28:15.915310+0000","last_active":"2024-08-17T02:28:15.927821+0000","last_peered":"2024-08-17T02:28:15.927821+0000","last_clean":"2024-08-17T02:28:15.927821+0000","last_became_active":"2024-08-17T02:28:15.915047+0000","last_became_peered":"2024-08-17T02:28:15.915047+0000","last_unstale":"2024-08-17T02:28:15.927821+0000","last_undegraded":"2024-08-17T02:28:15.927821+0000","last_fullsized":"2024-08-17T02:28:15.927821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:13.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890185+0000","last_change":"2024-08-17T02:28:14.893716+0000","last_active":"2024-08-17T02:28:15.890185+0000","last_peered":"2024-08-17T02:28:15.890185+0000","last_clean":"2024-08-17T02:28:15.890185+0000","last_became_active":"2024-08-17T02:28:14.893460+0000","last_became_peered":"2024-08-17T02:28:14.893460+0000","last_unstale":"2024-08-17T02:28:15.890185+0000","last_undegraded":"2024-08-17T02:28:15.890185+0000","last_fullsized":"2024-08-17T02:28:15.890185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:18.398070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921019+0000","last_change":"2024-08-17T02:28:15.913281+0000","last_active":"2024-08-17T02:28:15.921019+0000","last_peered":"2024-08-17T02:28:15.921019+0000","last_clean":"2024-08-17T02:28:15.921019+0000","last_became_active":"2024-08-17T02:28:15.912396+0000","last_became_peered":"2024-08-17T02:28:15.912396+0000","last_unstale":"2024-08-17T02:28:15.921019+0000","last_undegraded":"2024-08-17T02:28:15.921019+0000","last_fullsized":"2024-08-17T02:28:15.921019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:04.378229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890761+0000","last_change":"2024-08-17T02:28:14.900239+0000","last_active":"2024-08-17T02:28:15.890761+0000","last_peered":"2024-08-17T02:28:15.890761+0000","last_clean":"2024-08-17T02:28:15.890761+0000","last_became_active":"2024-08-17T02:28:14.899989+0000","last_became_peered":"2024-08-17T02:28:14.899989+0000","last_unstale":"2024-08-17T02:28:15.890761+0000","last_undegraded":"2024-08-17T02:28:15.890761+0000","last_fullsized":"2024-08-17T02:28:15.890761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:04.691182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920205+0000","last_change":"2024-08-17T02:28:15.911863+0000","last_active":"2024-08-17T02:28:15.920205+0000","last_peered":"2024-08-17T02:28:15.920205+0000","last_clean":"2024-08-17T02:28:15.920205+0000","last_became_active":"2024-08-17T02:28:15.911519+0000","last_became_peered":"2024-08-17T02:28:15.911519+0000","last_unstale":"2024-08-17T02:28:15.920205+0000","last_undegraded":"2024-08-17T02:28:15.920205+0000","last_fullsized":"2024-08-17T02:28:15.920205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:09.415021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929208+0000","last_change":"2024-08-17T02:28:14.900780+0000","last_active":"2024-08-17T02:28:15.929208+0000","last_peered":"2024-08-17T02:28:15.929208+0000","last_clean":"2024-08-17T02:28:15.929208+0000","last_became_active":"2024-08-17T02:28:14.899289+0000","last_became_peered":"2024-08-17T02:28:14.899289+0000","last_unstale":"2024-08-17T02:28:15.929208+0000","last_undegraded":"2024-08-17T02:28:15.929208+0000","last_fullsized":"2024-08-17T02:28:15.929208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:08.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.918531+0000","last_change":"2024-08-17T02:28:15.914126+0000","last_active":"2024-08-17T02:28:15.918531+0000","last_peered":"2024-08-17T02:28:15.918531+0000","last_clean":"2024-08-17T02:28:15.918531+0000","last_became_active":"2024-08-17T02:28:15.913815+0000","last_became_peered":"2024-08-17T02:28:15.913815+0000","last_unstale":"2024-08-17T02:28:15.918531+0000","last_undegraded":"2024-08-17T02:28:15.918531+0000","last_fullsized":"2024-08-17T02:28:15.918531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:10.328072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.930707+0000","last_change":"2024-08-17T02:28:14.900578+0000","last_active":"2024-08-17T02:28:15.930707+0000","last_peered":"2024-08-17T02:28:15.930707+0000","last_clean":"2024-08-17T02:28:15.930707+0000","last_became_active":"2024-08-17T02:28:14.900312+0000","last_became_peered":"2024-08-17T02:28:14.900312+0000","last_unstale":"2024-08-17T02:28:15.930707+0000","last_undegraded":"2024-08-17T02:28:15.930707+0000","last_fullsized":"2024-08-17T02:28:15.930707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:27.642301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.919203+0000","last_change":"2024-08-17T02:28:15.912751+0000","last_active":"2024-08-17T02:28:15.919203+0000","last_peered":"2024-08-17T02:28:15.919203+0000","last_clean":"2024-08-17T02:28:15.919203+0000","last_became_active":"2024-08-17T02:28:15.911398+0000","last_became_peered":"2024-08-17T02:28:15.911398+0000","last_unstale":"2024-08-17T02:28:15.919203+0000","last_undegraded":"2024-08-17T02:28:15.919203+0000","last_fullsized":"2024-08-17T02:28:15.919203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:08.593518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928346+0000","last_change":"2024-08-17T02:28:14.888024+0000","last_active":"2024-08-17T02:28:15.928346+0000","last_peered":"2024-08-17T02:28:15.928346+0000","last_clean":"2024-08-17T02:28:15.928346+0000","last_became_active":"2024-08-17T02:28:14.887467+0000","last_became_peered":"2024-08-17T02:28:14.887467+0000","last_unstale":"2024-08-17T02:28:15.928346+0000","last_undegraded":"2024-08-17T02:28:15.928346+0000","last_fullsized":"2024-08-17T02:28:15.928346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:55.958215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928051+0000","last_change":"2024-08-17T02:28:15.923239+0000","last_active":"2024-08-17T02:28:15.928051+0000","last_peered":"2024-08-17T02:28:15.928051+0000","last_clean":"2024-08-17T02:28:15.928051+0000","last_became_active":"2024-08-17T02:28:15.919511+0000","last_became_peered":"2024-08-17T02:28:15.919511+0000","last_unstale":"2024-08-17T02:28:15.928051+0000","last_undegraded":"2024-08-17T02:28:15.928051+0000","last_fullsized":"2024-08-17T02:28:15.928051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:12.965709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928425+0000","last_change":"2024-08-17T02:28:14.897917+0000","last_active":"2024-08-17T02:28:15.928425+0000","last_peered":"2024-08-17T02:28:15.928425+0000","last_clean":"2024-08-17T02:28:15.928425+0000","last_became_active":"2024-08-17T02:28:14.895928+0000","last_became_peered":"2024-08-17T02:28:14.895928+0000","last_unstale":"2024-08-17T02:28:15.928425+0000","last_undegraded":"2024-08-17T02:28:15.928425+0000","last_fullsized":"2024-08-17T02:28:15.928425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:26.505495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.909175+0000","last_change":"2024-08-17T02:28:15.903045+0000","last_active":"2024-08-17T02:28:15.909175+0000","last_peered":"2024-08-17T02:28:15.909175+0000","last_clean":"2024-08-17T02:28:15.909175+0000","last_became_active":"2024-08-17T02:28:15.902807+0000","last_became_peered":"2024-08-17T02:28:15.902807+0000","last_unstale":"2024-08-17T02:28:15.909175+0000","last_undegraded":"2024-08-17T02:28:15.909175+0000","last_fullsized":"2024-08-17T02:28:15.909175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:46.795770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905183+0000","last_change":"2024-08-17T02:28:14.889362+0000","last_active":"2024-08-17T02:28:15.905183+0000","last_peered":"2024-08-17T02:28:15.905183+0000","last_clean":"2024-08-17T02:28:15.905183+0000","last_became_active":"2024-08-17T02:28:14.888703+0000","last_became_peered":"2024-08-17T02:28:14.888703+0000","last_unstale":"2024-08-17T02:28:15.905183+0000","last_undegraded":"2024-08-17T02:28:15.905183+0000","last_fullsized":"2024-08-17T02:28:15.905183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:18.398070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916816+0000","last_change":"2024-08-17T02:28:15.913947+0000","last_active":"2024-08-17T02:28:15.916816+0000","last_peered":"2024-08-17T02:28:15.916816+0000","last_clean":"2024-08-17T02:28:15.916816+0000","last_became_active":"2024-08-17T02:28:15.913590+0000","last_became_peered":"2024-08-17T02:28:15.913590+0000","last_unstale":"2024-08-17T02:28:15.916816+0000","last_undegraded":"2024-08-17T02:28:15.916816+0000","last_fullsized":"2024-08-17T02:28:15.916816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:52.769676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929431+0000","last_change":"2024-08-17T02:28:14.893726+0000","last_active":"2024-08-17T02:28:15.929431+0000","last_peered":"2024-08-17T02:28:15.929431+0000","last_clean":"2024-08-17T02:28:15.929431+0000","last_became_active":"2024-08-17T02:28:14.893422+0000","last_became_peered":"2024-08-17T02:28:14.893422+0000","last_unstale":"2024-08-17T02:28:15.929431+0000","last_undegraded":"2024-08-17T02:28:15.929431+0000","last_fullsized":"2024-08-17T02:28:15.929431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:08.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.908987+0000","last_change":"2024-08-17T02:28:15.902652+0000","last_active":"2024-08-17T02:28:15.908987+0000","last_peered":"2024-08-17T02:28:15.908987+0000","last_clean":"2024-08-17T02:28:15.908987+0000","last_became_active":"2024-08-17T02:28:15.901634+0000","last_became_peered":"2024-08-17T02:28:15.901634+0000","last_unstale":"2024-08-17T02:28:15.908987+0000","last_undegraded":"2024-08-17T02:28:15.908987+0000","last_fullsized":"2024-08-17T02:28:15.908987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:33.368526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.899307+0000","last_change":"2024-08-17T02:28:14.896200+0000","last_active":"2024-08-17T02:28:15.899307+0000","last_peered":"2024-08-17T02:28:15.899307+0000","last_clean":"2024-08-17T02:28:15.899307+0000","last_became_active":"2024-08-17T02:28:14.895922+0000","last_became_peered":"2024-08-17T02:28:14.895922+0000","last_unstale":"2024-08-17T02:28:15.899307+0000","last_undegraded":"2024-08-17T02:28:15.899307+0000","last_fullsized":"2024-08-17T02:28:15.899307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:17.427818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906677+0000","last_change":"2024-08-17T02:28:15.899699+0000","last_active":"2024-08-17T02:28:15.906677+0000","last_peered":"2024-08-17T02:28:15.906677+0000","last_clean":"2024-08-17T02:28:15.906677+0000","last_became_active":"2024-08-17T02:28:15.898966+0000","last_became_peered":"2024-08-17T02:28:15.898966+0000","last_unstale":"2024-08-17T02:28:15.906677+0000","last_undegraded":"2024-08-17T02:28:15.906677+0000","last_fullsized":"2024-08-17T02:28:15.906677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:56.964520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905080+0000","last_change":"2024-08-17T02:28:14.893286+0000","last_active":"2024-08-17T02:28:15.905080+0000","last_peered":"2024-08-17T02:28:15.905080+0000","last_clean":"2024-08-17T02:28:15.905080+0000","last_became_active":"2024-08-17T02:28:14.892997+0000","last_became_peered":"2024-08-17T02:28:14.892997+0000","last_unstale":"2024-08-17T02:28:15.905080+0000","last_undegraded":"2024-08-17T02:28:15.905080+0000","last_fullsized":"2024-08-17T02:28:15.905080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:32.362221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.915772+0000","last_change":"2024-08-17T02:28:15.908753+0000","last_active":"2024-08-17T02:28:15.915772+0000","last_peered":"2024-08-17T02:28:15.915772+0000","last_clean":"2024-08-17T02:28:15.915772+0000","last_became_active":"2024-08-17T02:28:15.908477+0000","last_became_peered":"2024-08-17T02:28:15.908477+0000","last_unstale":"2024-08-17T02:28:15.915772+0000","last_undegraded":"2024-08-17T02:28:15.915772+0000","last_fullsized":"2024-08-17T02:28:15.915772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:08.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.894184+0000","last_change":"2024-08-17T02:28:14.897474+0000","last_active":"2024-08-17T02:28:15.894184+0000","last_peered":"2024-08-17T02:28:15.894184+0000","last_clean":"2024-08-17T02:28:15.894184+0000","last_became_active":"2024-08-17T02:28:14.897166+0000","last_became_peered":"2024-08-17T02:28:14.897166+0000","last_unstale":"2024-08-17T02:28:15.894184+0000","last_undegraded":"2024-08-17T02:28:15.894184+0000","last_fullsized":"2024-08-17T02:28:15.894184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:33.261147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.910673+0000","last_change":"2024-08-17T02:28:15.908014+0000","last_active":"2024-08-17T02:28:15.910673+0000","last_peered":"2024-08-17T02:28:15.910673+0000","last_clean":"2024-08-17T02:28:15.910673+0000","last_became_active":"2024-08-17T02:28:15.907562+0000","last_became_peered":"2024-08-17T02:28:15.907562+0000","last_unstale":"2024-08-17T02:28:15.910673+0000","last_undegraded":"2024-08-17T02:28:15.910673+0000","last_fullsized":"2024-08-17T02:28:15.910673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:20.519228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929942+0000","last_change":"2024-08-17T02:28:14.893869+0000","last_active":"2024-08-17T02:28:15.929942+0000","last_peered":"2024-08-17T02:28:15.929942+0000","last_clean":"2024-08-17T02:28:15.929942+0000","last_became_active":"2024-08-17T02:28:14.893542+0000","last_became_peered":"2024-08-17T02:28:14.893542+0000","last_unstale":"2024-08-17T02:28:15.929942+0000","last_undegraded":"2024-08-17T02:28:15.929942+0000","last_fullsized":"2024-08-17T02:28:15.929942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.789464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.919225+0000","last_change":"2024-08-17T02:28:15.913633+0000","last_active":"2024-08-17T02:28:15.919225+0000","last_peered":"2024-08-17T02:28:15.919225+0000","last_clean":"2024-08-17T02:28:15.919225+0000","last_became_active":"2024-08-17T02:28:15.913355+0000","last_became_peered":"2024-08-17T02:28:15.913355+0000","last_unstale":"2024-08-17T02:28:15.919225+0000","last_undegraded":"2024-08-17T02:28:15.919225+0000","last_fullsized":"2024-08-17T02:28:15.919225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:21.159860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:28:17.158903+0000","last_change":"2024-08-17T02:28:14.897947+0000","last_active":"2024-08-17T02:28:17.158903+0000","last_peered":"2024-08-17T02:28:17.158903+0000","last_clean":"2024-08-17T02:28:17.158903+0000","last_became_active":"2024-08-17T02:28:14.897681+0000","last_became_peered":"2024-08-17T02:28:14.897681+0000","last_unstale":"2024-08-17T02:28:17.158903+0000","last_undegraded":"2024-08-17T02:28:17.158903+0000","last_fullsized":"2024-08-17T02:28:17.158903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:26.903646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921100+0000","last_change":"2024-08-17T02:28:15.919843+0000","last_active":"2024-08-17T02:28:15.921100+0000","last_peered":"2024-08-17T02:28:15.921100+0000","last_clean":"2024-08-17T02:28:15.921100+0000","last_became_active":"2024-08-17T02:28:15.919503+0000","last_became_peered":"2024-08-17T02:28:15.919503+0000","last_unstale":"2024-08-17T02:28:15.921100+0000","last_undegraded":"2024-08-17T02:28:15.921100+0000","last_fullsized":"2024-08-17T02:28:15.921100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:05.262035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890002+0000","last_change":"2024-08-17T02:28:14.895084+0000","last_active":"2024-08-17T02:28:15.890002+0000","last_peered":"2024-08-17T02:28:15.890002+0000","last_clean":"2024-08-17T02:28:15.890002+0000","last_became_active":"2024-08-17T02:28:14.894818+0000","last_became_peered":"2024-08-17T02:28:14.894818+0000","last_unstale":"2024-08-17T02:28:15.890002+0000","last_undegraded":"2024-08-17T02:28:15.890002+0000","last_fullsized":"2024-08-17T02:28:15.890002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:17.427818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.907515+0000","last_change":"2024-08-17T02:28:15.900606+0000","last_active":"2024-08-17T02:28:15.907515+0000","last_peered":"2024-08-17T02:28:15.907515+0000","last_clean":"2024-08-17T02:28:15.907515+0000","last_became_active":"2024-08-17T02:28:15.900316+0000","last_became_peered":"2024-08-17T02:28:15.900316+0000","last_unstale":"2024-08-17T02:28:15.907515+0000","last_undegraded":"2024-08-17T02:28:15.907515+0000","last_fullsized":"2024-08-17T02:28:15.907515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:10.328072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.886494+0000","last_change":"2024-08-17T02:28:14.889270+0000","last_active":"2024-08-17T02:28:15.886494+0000","last_peered":"2024-08-17T02:28:15.886494+0000","last_clean":"2024-08-17T02:28:15.886494+0000","last_became_active":"2024-08-17T02:28:14.888994+0000","last_became_peered":"2024-08-17T02:28:14.888994+0000","last_unstale":"2024-08-17T02:28:15.886494+0000","last_undegraded":"2024-08-17T02:28:15.886494+0000","last_fullsized":"2024-08-17T02:28:15.886494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:03:41.416641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.918752+0000","last_change":"2024-08-17T02:28:15.906447+0000","last_active":"2024-08-17T02:28:15.918752+0000","last_peered":"2024-08-17T02:28:15.918752+0000","last_clean":"2024-08-17T02:28:15.918752+0000","last_became_active":"2024-08-17T02:28:15.906139+0000","last_became_peered":"2024-08-17T02:28:15.906139+0000","last_unstale":"2024-08-17T02:28:15.918752+0000","last_undegraded":"2024-08-17T02:28:15.918752+0000","last_fullsized":"2024-08-17T02:28:15.918752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:37.364500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890434+0000","last_change":"2024-08-17T02:28:14.899368+0000","last_active":"2024-08-17T02:28:15.890434+0000","last_peered":"2024-08-17T02:28:15.890434+0000","last_clean":"2024-08-17T02:28:15.890434+0000","last_became_active":"2024-08-17T02:28:14.897556+0000","last_became_peered":"2024-08-17T02:28:14.897556+0000","last_unstale":"2024-08-17T02:28:15.890434+0000","last_undegraded":"2024-08-17T02:28:15.890434+0000","last_fullsized":"2024-08-17T02:28:15.890434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:03:41.416641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.900218+0000","last_change":"2024-08-17T02:28:15.896389+0000","last_active":"2024-08-17T02:28:15.900218+0000","last_peered":"2024-08-17T02:28:15.900218+0000","last_clean":"2024-08-17T02:28:15.900218+0000","last_became_active":"2024-08-17T02:28:15.896144+0000","last_became_peered":"2024-08-17T02:28:15.896144+0000","last_unstale":"2024-08-17T02:28:15.900218+0000","last_undegraded":"2024-08-17T02:28:15.900218+0000","last_fullsized":"2024-08-17T02:28:15.900218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:30.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905182+0000","last_change":"2024-08-17T02:28:14.883518+0000","last_active":"2024-08-17T02:28:15.905182+0000","last_peered":"2024-08-17T02:28:15.905182+0000","last_clean":"2024-08-17T02:28:15.905182+0000","last_became_active":"2024-08-17T02:28:14.883142+0000","last_became_peered":"2024-08-17T02:28:14.883142+0000","last_unstale":"2024-08-17T02:28:15.905182+0000","last_undegraded":"2024-08-17T02:28:15.905182+0000","last_fullsized":"2024-08-17T02:28:15.905182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:26.108292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928196+0000","last_change":"2024-08-17T02:28:15.921411+0000","last_active":"2024-08-17T02:28:15.928196+0000","last_peered":"2024-08-17T02:28:15.928196+0000","last_clean":"2024-08-17T02:28:15.928196+0000","last_became_active":"2024-08-17T02:28:15.921140+0000","last_became_peered":"2024-08-17T02:28:15.921140+0000","last_unstale":"2024-08-17T02:28:15.928196+0000","last_undegraded":"2024-08-17T02:28:15.928196+0000","last_fullsized":"2024-08-17T02:28:15.928196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:50.209582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890838+0000","last_change":"2024-08-17T02:28:14.900563+0000","last_active":"2024-08-17T02:28:15.890838+0000","last_peered":"2024-08-17T02:28:15.890838+0000","last_clean":"2024-08-17T02:28:15.890838+0000","last_became_active":"2024-08-17T02:28:14.900324+0000","last_became_peered":"2024-08-17T02:28:14.900324+0000","last_unstale":"2024-08-17T02:28:15.890838+0000","last_undegraded":"2024-08-17T02:28:15.890838+0000","last_fullsized":"2024-08-17T02:28:15.890838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:09.321766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924204+0000","last_change":"2024-08-17T02:28:15.914819+0000","last_active":"2024-08-17T02:28:15.924204+0000","last_peered":"2024-08-17T02:28:15.924204+0000","last_clean":"2024-08-17T02:28:15.924204+0000","last_became_active":"2024-08-17T02:28:15.914560+0000","last_became_peered":"2024-08-17T02:28:15.914560+0000","last_unstale":"2024-08-17T02:28:15.924204+0000","last_undegraded":"2024-08-17T02:28:15.924204+0000","last_fullsized":"2024-08-17T02:28:15.924204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:50.653016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.897589+0000","last_change":"2024-08-17T02:28:14.896777+0000","last_active":"2024-08-17T02:28:15.897589+0000","last_peered":"2024-08-17T02:28:15.897589+0000","last_clean":"2024-08-17T02:28:15.897589+0000","last_became_active":"2024-08-17T02:28:14.893970+0000","last_became_peered":"2024-08-17T02:28:14.893970+0000","last_unstale":"2024-08-17T02:28:15.897589+0000","last_undegraded":"2024-08-17T02:28:15.897589+0000","last_fullsized":"2024-08-17T02:28:15.897589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:18.398070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.895299+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:28:15.895299+0000","last_peered":"2024-08-17T02:28:15.895299+0000","last_clean":"2024-08-17T02:28:15.895299+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:28:15.895299+0000","last_undegraded":"2024-08-17T02:28:15.895299+0000","last_fullsized":"2024-08-17T02:28:15.895299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:20.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.276+0000 7f396fc00640 1 Processor -- start 2024-08-17T02:28:20.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.276+0000 7f396fc00640 1 -- start start 2024-08-17T02:28:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.277+0000 7f396fc00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3968158e10 0x7f3968068180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.277+0000 7f396fc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39681591e0 0x7f39680686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.277+0000 7f396fc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39680c40a0 con 0x7f39680ace00 2024-08-17T02:28:20.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.277+0000 7f396fc00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39680694e0 con 0x7f3968158e10 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.277+0000 7f396fc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3968069240 con 0x7f39681591e0 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.277+0000 7f396d200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3968158e10 0x7f3968068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f396d200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3968158e10 0x7f3968068180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34056/0 (socket says 172.21.15.42:34056) 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f396d200640 1 -- 172.21.15.42:0/637327506 learned_addr learned my addr 172.21.15.42:0/637327506 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f3967e00640 1 --2- 172.21.15.42:0/637327506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39681591e0 0x7f39680686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f396d200640 1 -- 172.21.15.42:0/637327506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39681591e0 msgr2=0x7f39680686c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f396d200640 1 --2- 172.21.15.42:0/637327506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39681591e0 0x7f39680686c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f396d200640 1 -- 172.21.15.42:0/637327506 >> v1:172.21.15.62:6789/0 conn(0x7f39680ace00 legacy=0x7f39680c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.278+0000 7f396d200640 1 -- 172.21.15.42:0/637327506 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680c3a50 con 0x7f3968158e10 2024-08-17T02:28:20.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.279+0000 7f396d200640 1 --2- 172.21.15.42:0/637327506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3968158e10 0x7f3968068180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f395c009910 tx=0x7f395c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddca6c4eb226799 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.279+0000 7f3967400640 1 -- 172.21.15.42:0/637327506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c02ae40 con 0x7f3968158e10 2024-08-17T02:28:20.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.279+0000 7f3967400640 1 -- 172.21.15.42:0/637327506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c032440 con 0x7f3968158e10 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.279+0000 7f3967400640 1 -- 172.21.15.42:0/637327506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c032820 con 0x7f3968158e10 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 -- 172.21.15.42:0/637327506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3968158e10 msgr2=0x7f3968068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 --2- 172.21.15.42:0/637327506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3968158e10 0x7f3968068180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f395c009910 tx=0x7f395c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 -- 172.21.15.42:0/637327506 shutdown_connections 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 --2- 172.21.15.42:0/637327506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39681591e0 0x7f39680686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 --2- 172.21.15.42:0/637327506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3968158e10 0x7f3968068180 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 -- 172.21.15.42:0/637327506 >> 172.21.15.42:0/637327506 conn(0x7f39680ce590 msgr2=0x7f39680ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 -- 172.21.15.42:0/637327506 shutdown_connections 2024-08-17T02:28:20.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.280+0000 7f396fc00640 1 -- 172.21.15.42:0/637327506 wait complete. 2024-08-17T02:28:20.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.281+0000 7f396fc00640 1 Processor -- start 2024-08-17T02:28:20.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.281+0000 7f396fc00640 1 -- start start 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.282+0000 7f396fc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 0x7f3968154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.282+0000 7f396fc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3968158e10 0x7f39680adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.282+0000 7f396fc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39681591e0 0x7f3968169420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.282+0000 7f396fc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680af2c0 con 0x7f39680ace00 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.282+0000 7f396fc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968169ff0 con 0x7f39681591e0 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.282+0000 7f396fc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396816a2d0 con 0x7f3968158e10 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 0x7f3968154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 0x7f3968154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34072/0 (socket says 172.21.15.42:34072) 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 -- 172.21.15.42:0/3681729887 learned_addr learned my addr 172.21.15.42:0/3681729887 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396dc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39681591e0 0x7f3968169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f3967e00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3968158e10 0x7f39680adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 -- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3968158e10 msgr2=0x7f39680adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3968158e10 0x7f39680adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 -- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39681591e0 msgr2=0x7f3968169420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39681591e0 0x7f3968169420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 -- 172.21.15.42:0/3681729887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c009450 con 0x7f39680ace00 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f3967e00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3968158e10 0x7f39680adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396dc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39681591e0 0x7f3968169420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396d200640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 0x7f3968154870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f395c035040 tx=0x7f395c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c031bb0 con 0x7f39680ace00 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c031d70 con 0x7f39680ace00 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c03d670 con 0x7f39680ace00 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.283+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39680ad3c0 con 0x7f39680ace00 2024-08-17T02:28:20.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.284+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39680ad980 con 0x7f39680ace00 2024-08-17T02:28:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.285+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3968063fb0 con 0x7f39680ace00 2024-08-17T02:28:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.285+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f395c039040 con 0x7f39680ace00 2024-08-17T02:28:20.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.286+0000 7f395be00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3948065150 0x7f3948067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.286+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f395c02ae40 con 0x7f39680ace00 2024-08-17T02:28:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.286+0000 7f3967e00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3948065150 0x7f3948067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.287+0000 7f3967e00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3948065150 0x7f3948067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f396806f1f0 tx=0x7f3954008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.290+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f395c0702e0 con 0x7f39680ace00 2024-08-17T02:28:20.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.471+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39680ccb50 con 0x7f3948065150 2024-08-17T02:28:20.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.477+0000 7f395be00640 1 -- 172.21.15.42:0/3681729887 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264654 (secure 0 0 0) 0x7f39680ccb50 con 0x7f3948065150 2024-08-17T02:28:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:20.482 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.481+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3948065150 msgr2=0x7f3948067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.481+0000 7f396fc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3948065150 0x7f3948067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f396806f1f0 tx=0x7f3954008040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.481+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 msgr2=0x7f3968154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 0x7f3968154870 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f395c035040 tx=0x7f395c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 shutdown_connections 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3948065150 0x7f3948067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39681591e0 0x7f3968169420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3968158e10 0x7f39680adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 --2- 172.21.15.42:0/3681729887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39680ace00 0x7f3968154870 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 >> 172.21.15.42:0/3681729887 conn(0x7f39680ce590 msgr2=0x7f3968068000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 shutdown_connections 2024-08-17T02:28:20.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.482+0000 7f396fc00640 1 -- 172.21.15.42:0/3681729887 wait complete. 2024-08-17T02:28:20.497 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:28:19.193029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399536,"kb_used_data":4040,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575184,"statfs":{"total":773094113280,"available":770636988416,"internally_reserved":0,"allocated":4136960,"data_stored":2292396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.323981"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.912669+0000","last_change":"2024-08-17T02:28:15.907170+0000","last_active":"2024-08-17T02:28:15.912669+0000","last_peered":"2024-08-17T02:28:15.912669+0000","last_clean":"2024-08-17T02:28:15.912669+0000","last_became_active":"2024-08-17T02:28:15.906926+0000","last_became_peered":"2024-08-17T02:28:15.906926+0000","last_unstale":"2024-08-17T02:28:15.912669+0000","last_undegraded":"2024-08-17T02:28:15.912669+0000","last_fullsized":"2024-08-17T02:28:15.912669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:34.267452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926183+0000","last_change":"2024-08-17T02:28:15.915399+0000","last_active":"2024-08-17T02:28:15.926183+0000","last_peered":"2024-08-17T02:28:15.926183+0000","last_clean":"2024-08-17T02:28:15.926183+0000","last_became_active":"2024-08-17T02:28:15.913082+0000","last_became_peered":"2024-08-17T02:28:15.913082+0000","last_unstale":"2024-08-17T02:28:15.926183+0000","last_undegraded":"2024-08-17T02:28:15.926183+0000","last_fullsized":"2024-08-17T02:28:15.926183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:04.378229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923676+0000","last_change":"2024-08-17T02:28:15.918534+0000","last_active":"2024-08-17T02:28:15.923676+0000","last_peered":"2024-08-17T02:28:15.923676+0000","last_clean":"2024-08-17T02:28:15.923676+0000","last_became_active":"2024-08-17T02:28:15.918212+0000","last_became_peered":"2024-08-17T02:28:15.918212+0000","last_unstale":"2024-08-17T02:28:15.923676+0000","last_undegraded":"2024-08-17T02:28:15.923676+0000","last_fullsized":"2024-08-17T02:28:15.923676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:40.151747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927275+0000","last_change":"2024-08-17T02:28:15.920605+0000","last_active":"2024-08-17T02:28:15.927275+0000","last_peered":"2024-08-17T02:28:15.927275+0000","last_clean":"2024-08-17T02:28:15.927275+0000","last_became_active":"2024-08-17T02:28:15.920316+0000","last_became_peered":"2024-08-17T02:28:15.920316+0000","last_unstale":"2024-08-17T02:28:15.927275+0000","last_undegraded":"2024-08-17T02:28:15.927275+0000","last_fullsized":"2024-08-17T02:28:15.927275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:05.262035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906579+0000","last_change":"2024-08-17T02:28:15.898871+0000","last_active":"2024-08-17T02:28:15.906579+0000","last_peered":"2024-08-17T02:28:15.906579+0000","last_clean":"2024-08-17T02:28:15.906579+0000","last_became_active":"2024-08-17T02:28:15.898575+0000","last_became_peered":"2024-08-17T02:28:15.898575+0000","last_unstale":"2024-08-17T02:28:15.906579+0000","last_undegraded":"2024-08-17T02:28:15.906579+0000","last_fullsized":"2024-08-17T02:28:15.906579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:18.434123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927457+0000","last_change":"2024-08-17T02:28:15.920704+0000","last_active":"2024-08-17T02:28:15.927457+0000","last_peered":"2024-08-17T02:28:15.927457+0000","last_clean":"2024-08-17T02:28:15.927457+0000","last_became_active":"2024-08-17T02:28:15.915109+0000","last_became_peered":"2024-08-17T02:28:15.915109+0000","last_unstale":"2024-08-17T02:28:15.927457+0000","last_undegraded":"2024-08-17T02:28:15.927457+0000","last_fullsized":"2024-08-17T02:28:15.927457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:51.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.909218+0000","last_change":"2024-08-17T02:28:15.906824+0000","last_active":"2024-08-17T02:28:15.909218+0000","last_peered":"2024-08-17T02:28:15.909218+0000","last_clean":"2024-08-17T02:28:15.909218+0000","last_became_active":"2024-08-17T02:28:15.906592+0000","last_became_peered":"2024-08-17T02:28:15.906592+0000","last_unstale":"2024-08-17T02:28:15.909218+0000","last_undegraded":"2024-08-17T02:28:15.909218+0000","last_fullsized":"2024-08-17T02:28:15.909218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:13.979813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.915261+0000","last_change":"2024-08-17T02:28:15.908734+0000","last_active":"2024-08-17T02:28:15.915261+0000","last_peered":"2024-08-17T02:28:15.915261+0000","last_clean":"2024-08-17T02:28:15.915261+0000","last_became_active":"2024-08-17T02:28:15.906181+0000","last_became_peered":"2024-08-17T02:28:15.906181+0000","last_unstale":"2024-08-17T02:28:15.915261+0000","last_undegraded":"2024-08-17T02:28:15.915261+0000","last_fullsized":"2024-08-17T02:28:15.915261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:35:20.478251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928212+0000","last_change":"2024-08-17T02:28:15.921738+0000","last_active":"2024-08-17T02:28:15.928212+0000","last_peered":"2024-08-17T02:28:15.928212+0000","last_clean":"2024-08-17T02:28:15.928212+0000","last_became_active":"2024-08-17T02:28:15.921417+0000","last_became_peered":"2024-08-17T02:28:15.921417+0000","last_unstale":"2024-08-17T02:28:15.928212+0000","last_undegraded":"2024-08-17T02:28:15.928212+0000","last_fullsized":"2024-08-17T02:28:15.928212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:34:49.675780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927872+0000","last_change":"2024-08-17T02:28:15.921486+0000","last_active":"2024-08-17T02:28:15.927872+0000","last_peered":"2024-08-17T02:28:15.927872+0000","last_clean":"2024-08-17T02:28:15.927872+0000","last_became_active":"2024-08-17T02:28:15.921011+0000","last_became_peered":"2024-08-17T02:28:15.921011+0000","last_unstale":"2024-08-17T02:28:15.927872+0000","last_undegraded":"2024-08-17T02:28:15.927872+0000","last_fullsized":"2024-08-17T02:28:15.927872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:51:32.011598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924277+0000","last_change":"2024-08-17T02:28:15.917515+0000","last_active":"2024-08-17T02:28:15.924277+0000","last_peered":"2024-08-17T02:28:15.924277+0000","last_clean":"2024-08-17T02:28:15.924277+0000","last_became_active":"2024-08-17T02:28:15.917213+0000","last_became_peered":"2024-08-17T02:28:15.917213+0000","last_unstale":"2024-08-17T02:28:15.924277+0000","last_undegraded":"2024-08-17T02:28:15.924277+0000","last_fullsized":"2024-08-17T02:28:15.924277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:50.209582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.904970+0000","last_change":"2024-08-17T02:28:15.902221+0000","last_active":"2024-08-17T02:28:15.904970+0000","last_peered":"2024-08-17T02:28:15.904970+0000","last_clean":"2024-08-17T02:28:15.904970+0000","last_became_active":"2024-08-17T02:28:15.901917+0000","last_became_peered":"2024-08-17T02:28:15.901917+0000","last_unstale":"2024-08-17T02:28:15.904970+0000","last_undegraded":"2024-08-17T02:28:15.904970+0000","last_fullsized":"2024-08-17T02:28:15.904970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:27.093404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906603+0000","last_change":"2024-08-17T02:28:15.898651+0000","last_active":"2024-08-17T02:28:15.906603+0000","last_peered":"2024-08-17T02:28:15.906603+0000","last_clean":"2024-08-17T02:28:15.906603+0000","last_became_active":"2024-08-17T02:28:15.898300+0000","last_became_peered":"2024-08-17T02:28:15.898300+0000","last_unstale":"2024-08-17T02:28:15.906603+0000","last_undegraded":"2024-08-17T02:28:15.906603+0000","last_fullsized":"2024-08-17T02:28:15.906603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:19.404375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927480+0000","last_change":"2024-08-17T02:28:15.920856+0000","last_active":"2024-08-17T02:28:15.927480+0000","last_peered":"2024-08-17T02:28:15.927480+0000","last_clean":"2024-08-17T02:28:15.927480+0000","last_became_active":"2024-08-17T02:28:15.920426+0000","last_became_peered":"2024-08-17T02:28:15.920426+0000","last_unstale":"2024-08-17T02:28:15.927480+0000","last_undegraded":"2024-08-17T02:28:15.927480+0000","last_fullsized":"2024-08-17T02:28:15.927480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:16.624145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905751+0000","last_change":"2024-08-17T02:28:15.902971+0000","last_active":"2024-08-17T02:28:15.905751+0000","last_peered":"2024-08-17T02:28:15.905751+0000","last_clean":"2024-08-17T02:28:15.905751+0000","last_became_active":"2024-08-17T02:28:15.902754+0000","last_became_peered":"2024-08-17T02:28:15.902754+0000","last_unstale":"2024-08-17T02:28:15.905751+0000","last_undegraded":"2024-08-17T02:28:15.905751+0000","last_fullsized":"2024-08-17T02:28:15.905751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:51.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921000+0000","last_change":"2024-08-17T02:28:15.911336+0000","last_active":"2024-08-17T02:28:15.921000+0000","last_peered":"2024-08-17T02:28:15.921000+0000","last_clean":"2024-08-17T02:28:15.921000+0000","last_became_active":"2024-08-17T02:28:15.911006+0000","last_became_peered":"2024-08-17T02:28:15.911006+0000","last_unstale":"2024-08-17T02:28:15.921000+0000","last_undegraded":"2024-08-17T02:28:15.921000+0000","last_fullsized":"2024-08-17T02:28:15.921000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:46:51.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920617+0000","last_change":"2024-08-17T02:28:15.909300+0000","last_active":"2024-08-17T02:28:15.920617+0000","last_peered":"2024-08-17T02:28:15.920617+0000","last_clean":"2024-08-17T02:28:15.920617+0000","last_became_active":"2024-08-17T02:28:15.908987+0000","last_became_peered":"2024-08-17T02:28:15.908987+0000","last_unstale":"2024-08-17T02:28:15.920617+0000","last_undegraded":"2024-08-17T02:28:15.920617+0000","last_fullsized":"2024-08-17T02:28:15.920617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:16.624145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926203+0000","last_change":"2024-08-17T02:28:15.915639+0000","last_active":"2024-08-17T02:28:15.926203+0000","last_peered":"2024-08-17T02:28:15.926203+0000","last_clean":"2024-08-17T02:28:15.926203+0000","last_became_active":"2024-08-17T02:28:15.915013+0000","last_became_peered":"2024-08-17T02:28:15.915013+0000","last_unstale":"2024-08-17T02:28:15.926203+0000","last_undegraded":"2024-08-17T02:28:15.926203+0000","last_fullsized":"2024-08-17T02:28:15.926203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:40.151747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927538+0000","last_change":"2024-08-17T02:28:15.921183+0000","last_active":"2024-08-17T02:28:15.927538+0000","last_peered":"2024-08-17T02:28:15.927538+0000","last_clean":"2024-08-17T02:28:15.927538+0000","last_became_active":"2024-08-17T02:28:15.920547+0000","last_became_peered":"2024-08-17T02:28:15.920547+0000","last_unstale":"2024-08-17T02:28:15.927538+0000","last_undegraded":"2024-08-17T02:28:15.927538+0000","last_fullsized":"2024-08-17T02:28:15.927538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:08.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.908049+0000","last_change":"2024-08-17T02:28:15.906172+0000","last_active":"2024-08-17T02:28:15.908049+0000","last_peered":"2024-08-17T02:28:15.908049+0000","last_clean":"2024-08-17T02:28:15.908049+0000","last_became_active":"2024-08-17T02:28:15.905884+0000","last_became_peered":"2024-08-17T02:28:15.905884+0000","last_unstale":"2024-08-17T02:28:15.908049+0000","last_undegraded":"2024-08-17T02:28:15.908049+0000","last_fullsized":"2024-08-17T02:28:15.908049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:27.114597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924216+0000","last_change":"2024-08-17T02:28:15.917485+0000","last_active":"2024-08-17T02:28:15.924216+0000","last_peered":"2024-08-17T02:28:15.924216+0000","last_clean":"2024-08-17T02:28:15.924216+0000","last_became_active":"2024-08-17T02:28:15.917241+0000","last_became_peered":"2024-08-17T02:28:15.917241+0000","last_unstale":"2024-08-17T02:28:15.924216+0000","last_undegraded":"2024-08-17T02:28:15.924216+0000","last_fullsized":"2024-08-17T02:28:15.924216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:50.653016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916934+0000","last_change":"2024-08-17T02:28:15.909792+0000","last_active":"2024-08-17T02:28:15.916934+0000","last_peered":"2024-08-17T02:28:15.916934+0000","last_clean":"2024-08-17T02:28:15.916934+0000","last_became_active":"2024-08-17T02:28:15.909315+0000","last_became_peered":"2024-08-17T02:28:15.909315+0000","last_unstale":"2024-08-17T02:28:15.916934+0000","last_undegraded":"2024-08-17T02:28:15.916934+0000","last_fullsized":"2024-08-17T02:28:15.916934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:05.262035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916450+0000","last_change":"2024-08-17T02:28:15.897683+0000","last_active":"2024-08-17T02:28:15.916450+0000","last_peered":"2024-08-17T02:28:15.916450+0000","last_clean":"2024-08-17T02:28:15.916450+0000","last_became_active":"2024-08-17T02:28:15.897355+0000","last_became_peered":"2024-08-17T02:28:15.897355+0000","last_unstale":"2024-08-17T02:28:15.916450+0000","last_undegraded":"2024-08-17T02:28:15.916450+0000","last_fullsized":"2024-08-17T02:28:15.916450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:34:49.675780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.915986+0000","last_change":"2024-08-17T02:28:15.908272+0000","last_active":"2024-08-17T02:28:15.915986+0000","last_peered":"2024-08-17T02:28:15.915986+0000","last_clean":"2024-08-17T02:28:15.915986+0000","last_became_active":"2024-08-17T02:28:15.907768+0000","last_became_peered":"2024-08-17T02:28:15.907768+0000","last_unstale":"2024-08-17T02:28:15.915986+0000","last_undegraded":"2024-08-17T02:28:15.915986+0000","last_fullsized":"2024-08-17T02:28:15.915986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:16.624145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.919186+0000","last_change":"2024-08-17T02:28:15.914555+0000","last_active":"2024-08-17T02:28:15.919186+0000","last_peered":"2024-08-17T02:28:15.919186+0000","last_clean":"2024-08-17T02:28:15.919186+0000","last_became_active":"2024-08-17T02:28:15.914136+0000","last_became_peered":"2024-08-17T02:28:15.914136+0000","last_unstale":"2024-08-17T02:28:15.919186+0000","last_undegraded":"2024-08-17T02:28:15.919186+0000","last_fullsized":"2024-08-17T02:28:15.919186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:03:13.979813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926220+0000","last_change":"2024-08-17T02:28:15.916327+0000","last_active":"2024-08-17T02:28:15.926220+0000","last_peered":"2024-08-17T02:28:15.926220+0000","last_clean":"2024-08-17T02:28:15.926220+0000","last_became_active":"2024-08-17T02:28:15.916070+0000","last_became_peered":"2024-08-17T02:28:15.916070+0000","last_unstale":"2024-08-17T02:28:15.926220+0000","last_undegraded":"2024-08-17T02:28:15.926220+0000","last_fullsized":"2024-08-17T02:28:15.926220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:02.574091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923810+0000","last_change":"2024-08-17T02:28:15.917922+0000","last_active":"2024-08-17T02:28:15.923810+0000","last_peered":"2024-08-17T02:28:15.923810+0000","last_clean":"2024-08-17T02:28:15.923810+0000","last_became_active":"2024-08-17T02:28:15.917680+0000","last_became_peered":"2024-08-17T02:28:15.917680+0000","last_unstale":"2024-08-17T02:28:15.923810+0000","last_undegraded":"2024-08-17T02:28:15.923810+0000","last_fullsized":"2024-08-17T02:28:15.923810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:30.685480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.904951+0000","last_change":"2024-08-17T02:28:15.899923+0000","last_active":"2024-08-17T02:28:15.904951+0000","last_peered":"2024-08-17T02:28:15.904951+0000","last_clean":"2024-08-17T02:28:15.904951+0000","last_became_active":"2024-08-17T02:28:15.899621+0000","last_became_peered":"2024-08-17T02:28:15.899621+0000","last_unstale":"2024-08-17T02:28:15.904951+0000","last_undegraded":"2024-08-17T02:28:15.904951+0000","last_fullsized":"2024-08-17T02:28:15.904951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:02.574091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928463+0000","last_change":"2024-08-17T02:28:15.922554+0000","last_active":"2024-08-17T02:28:15.928463+0000","last_peered":"2024-08-17T02:28:15.928463+0000","last_clean":"2024-08-17T02:28:15.928463+0000","last_became_active":"2024-08-17T02:28:15.922241+0000","last_became_peered":"2024-08-17T02:28:15.922241+0000","last_unstale":"2024-08-17T02:28:15.928463+0000","last_undegraded":"2024-08-17T02:28:15.928463+0000","last_fullsized":"2024-08-17T02:28:15.928463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:37.364500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920657+0000","last_change":"2024-08-17T02:28:15.909483+0000","last_active":"2024-08-17T02:28:15.920657+0000","last_peered":"2024-08-17T02:28:15.920657+0000","last_clean":"2024-08-17T02:28:15.920657+0000","last_became_active":"2024-08-17T02:28:15.908979+0000","last_became_peered":"2024-08-17T02:28:15.908979+0000","last_unstale":"2024-08-17T02:28:15.920657+0000","last_undegraded":"2024-08-17T02:28:15.920657+0000","last_fullsized":"2024-08-17T02:28:15.920657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:27.093404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.908052+0000","last_change":"2024-08-17T02:28:15.903250+0000","last_active":"2024-08-17T02:28:15.908052+0000","last_peered":"2024-08-17T02:28:15.908052+0000","last_clean":"2024-08-17T02:28:15.908052+0000","last_became_active":"2024-08-17T02:28:15.902944+0000","last_became_peered":"2024-08-17T02:28:15.902944+0000","last_unstale":"2024-08-17T02:28:15.908052+0000","last_undegraded":"2024-08-17T02:28:15.908052+0000","last_fullsized":"2024-08-17T02:28:15.908052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:50.653016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921053+0000","last_change":"2024-08-17T02:28:15.913493+0000","last_active":"2024-08-17T02:28:15.921053+0000","last_peered":"2024-08-17T02:28:15.921053+0000","last_clean":"2024-08-17T02:28:15.921053+0000","last_became_active":"2024-08-17T02:28:15.912993+0000","last_became_peered":"2024-08-17T02:28:15.912993+0000","last_unstale":"2024-08-17T02:28:15.921053+0000","last_undegraded":"2024-08-17T02:28:15.921053+0000","last_fullsized":"2024-08-17T02:28:15.921053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:02.574091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.918215+0000","last_change":"2024-08-17T02:28:15.906972+0000","last_active":"2024-08-17T02:28:15.918215+0000","last_peered":"2024-08-17T02:28:15.918215+0000","last_clean":"2024-08-17T02:28:15.918215+0000","last_became_active":"2024-08-17T02:28:15.905751+0000","last_became_peered":"2024-08-17T02:28:15.905751+0000","last_unstale":"2024-08-17T02:28:15.918215+0000","last_undegraded":"2024-08-17T02:28:15.918215+0000","last_fullsized":"2024-08-17T02:28:15.918215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:12.965709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924380+0000","last_change":"2024-08-17T02:28:14.897309+0000","last_active":"2024-08-17T02:28:15.924380+0000","last_peered":"2024-08-17T02:28:15.924380+0000","last_clean":"2024-08-17T02:28:15.924380+0000","last_became_active":"2024-08-17T02:28:14.894924+0000","last_became_peered":"2024-08-17T02:28:14.894924+0000","last_unstale":"2024-08-17T02:28:15.924380+0000","last_undegraded":"2024-08-17T02:28:15.924380+0000","last_fullsized":"2024-08-17T02:28:15.924380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.789464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920285+0000","last_change":"2024-08-17T02:28:15.912768+0000","last_active":"2024-08-17T02:28:15.920285+0000","last_peered":"2024-08-17T02:28:15.920285+0000","last_clean":"2024-08-17T02:28:15.920285+0000","last_became_active":"2024-08-17T02:28:15.911006+0000","last_became_peered":"2024-08-17T02:28:15.911006+0000","last_unstale":"2024-08-17T02:28:15.920285+0000","last_undegraded":"2024-08-17T02:28:15.920285+0000","last_fullsized":"2024-08-17T02:28:15.920285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:05.697487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928638+0000","last_change":"2024-08-17T02:28:14.901732+0000","last_active":"2024-08-17T02:28:15.928638+0000","last_peered":"2024-08-17T02:28:15.928638+0000","last_clean":"2024-08-17T02:28:15.928638+0000","last_became_active":"2024-08-17T02:28:14.901411+0000","last_became_peered":"2024-08-17T02:28:14.901411+0000","last_unstale":"2024-08-17T02:28:15.928638+0000","last_undegraded":"2024-08-17T02:28:15.928638+0000","last_fullsized":"2024-08-17T02:28:15.928638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:40.720695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916631+0000","last_change":"2024-08-17T02:28:15.911097+0000","last_active":"2024-08-17T02:28:15.916631+0000","last_peered":"2024-08-17T02:28:15.916631+0000","last_clean":"2024-08-17T02:28:15.916631+0000","last_became_active":"2024-08-17T02:28:15.910832+0000","last_became_peered":"2024-08-17T02:28:15.910832+0000","last_unstale":"2024-08-17T02:28:15.916631+0000","last_undegraded":"2024-08-17T02:28:15.916631+0000","last_fullsized":"2024-08-17T02:28:15.916631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:12.965709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928851+0000","last_change":"2024-08-17T02:28:14.901047+0000","last_active":"2024-08-17T02:28:15.928851+0000","last_peered":"2024-08-17T02:28:15.928851+0000","last_clean":"2024-08-17T02:28:15.928851+0000","last_became_active":"2024-08-17T02:28:14.900768+0000","last_became_peered":"2024-08-17T02:28:14.900768+0000","last_unstale":"2024-08-17T02:28:15.928851+0000","last_undegraded":"2024-08-17T02:28:15.928851+0000","last_fullsized":"2024-08-17T02:28:15.928851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:06.989586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923791+0000","last_change":"2024-08-17T02:28:15.917869+0000","last_active":"2024-08-17T02:28:15.923791+0000","last_peered":"2024-08-17T02:28:15.923791+0000","last_clean":"2024-08-17T02:28:15.923791+0000","last_became_active":"2024-08-17T02:28:15.917317+0000","last_became_peered":"2024-08-17T02:28:15.917317+0000","last_unstale":"2024-08-17T02:28:15.923791+0000","last_undegraded":"2024-08-17T02:28:15.923791+0000","last_fullsized":"2024-08-17T02:28:15.923791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:34:49.675780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924506+0000","last_change":"2024-08-17T02:28:14.895695+0000","last_active":"2024-08-17T02:28:15.924506+0000","last_peered":"2024-08-17T02:28:15.924506+0000","last_clean":"2024-08-17T02:28:15.924506+0000","last_became_active":"2024-08-17T02:28:14.895322+0000","last_became_peered":"2024-08-17T02:28:14.895322+0000","last_unstale":"2024-08-17T02:28:15.924506+0000","last_undegraded":"2024-08-17T02:28:15.924506+0000","last_fullsized":"2024-08-17T02:28:15.924506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:30:16.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920679+0000","last_change":"2024-08-17T02:28:15.912138+0000","last_active":"2024-08-17T02:28:15.920679+0000","last_peered":"2024-08-17T02:28:15.920679+0000","last_clean":"2024-08-17T02:28:15.920679+0000","last_became_active":"2024-08-17T02:28:15.911860+0000","last_became_peered":"2024-08-17T02:28:15.911860+0000","last_unstale":"2024-08-17T02:28:15.920679+0000","last_undegraded":"2024-08-17T02:28:15.920679+0000","last_fullsized":"2024-08-17T02:28:15.920679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:08.593518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929488+0000","last_change":"2024-08-17T02:28:14.888946+0000","last_active":"2024-08-17T02:28:15.929488+0000","last_peered":"2024-08-17T02:28:15.929488+0000","last_clean":"2024-08-17T02:28:15.929488+0000","last_became_active":"2024-08-17T02:28:14.888666+0000","last_became_peered":"2024-08-17T02:28:14.888666+0000","last_unstale":"2024-08-17T02:28:15.929488+0000","last_undegraded":"2024-08-17T02:28:15.929488+0000","last_fullsized":"2024-08-17T02:28:15.929488+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:17.427818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.913086+0000","last_change":"2024-08-17T02:28:15.907635+0000","last_active":"2024-08-17T02:28:15.913086+0000","last_peered":"2024-08-17T02:28:15.913086+0000","last_clean":"2024-08-17T02:28:15.913086+0000","last_became_active":"2024-08-17T02:28:15.906829+0000","last_became_peered":"2024-08-17T02:28:15.906829+0000","last_unstale":"2024-08-17T02:28:15.913086+0000","last_undegraded":"2024-08-17T02:28:15.913086+0000","last_fullsized":"2024-08-17T02:28:15.913086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:04.378229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928947+0000","last_change":"2024-08-17T02:28:14.889015+0000","last_active":"2024-08-17T02:28:15.928947+0000","last_peered":"2024-08-17T02:28:15.928947+0000","last_clean":"2024-08-17T02:28:15.928947+0000","last_became_active":"2024-08-17T02:28:14.888742+0000","last_became_peered":"2024-08-17T02:28:14.888742+0000","last_unstale":"2024-08-17T02:28:15.928947+0000","last_undegraded":"2024-08-17T02:28:15.928947+0000","last_fullsized":"2024-08-17T02:28:15.928947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:19.512922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916439+0000","last_change":"2024-08-17T02:28:15.909765+0000","last_active":"2024-08-17T02:28:15.916439+0000","last_peered":"2024-08-17T02:28:15.916439+0000","last_clean":"2024-08-17T02:28:15.916439+0000","last_became_active":"2024-08-17T02:28:15.909447+0000","last_became_peered":"2024-08-17T02:28:15.909447+0000","last_unstale":"2024-08-17T02:28:15.916439+0000","last_undegraded":"2024-08-17T02:28:15.916439+0000","last_fullsized":"2024-08-17T02:28:15.916439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:09.415021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890861+0000","last_change":"2024-08-17T02:28:14.895225+0000","last_active":"2024-08-17T02:28:15.890861+0000","last_peered":"2024-08-17T02:28:15.890861+0000","last_clean":"2024-08-17T02:28:15.890861+0000","last_became_active":"2024-08-17T02:28:14.894907+0000","last_became_peered":"2024-08-17T02:28:14.894907+0000","last_unstale":"2024-08-17T02:28:15.890861+0000","last_undegraded":"2024-08-17T02:28:15.890861+0000","last_fullsized":"2024-08-17T02:28:15.890861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:29:40.720695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.907569+0000","last_change":"2024-08-17T02:28:15.900609+0000","last_active":"2024-08-17T02:28:15.907569+0000","last_peered":"2024-08-17T02:28:15.907569+0000","last_clean":"2024-08-17T02:28:15.907569+0000","last_became_active":"2024-08-17T02:28:15.900333+0000","last_became_peered":"2024-08-17T02:28:15.900333+0000","last_unstale":"2024-08-17T02:28:15.907569+0000","last_undegraded":"2024-08-17T02:28:15.907569+0000","last_fullsized":"2024-08-17T02:28:15.907569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:50.209582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.904586+0000","last_change":"2024-08-17T02:28:14.888083+0000","last_active":"2024-08-17T02:28:15.904586+0000","last_peered":"2024-08-17T02:28:15.904586+0000","last_clean":"2024-08-17T02:28:15.904586+0000","last_became_active":"2024-08-17T02:28:14.887738+0000","last_became_peered":"2024-08-17T02:28:14.887738+0000","last_unstale":"2024-08-17T02:28:15.904586+0000","last_undegraded":"2024-08-17T02:28:15.904586+0000","last_fullsized":"2024-08-17T02:28:15.904586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:55.664371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.923288+0000","last_change":"2024-08-17T02:28:15.919197+0000","last_active":"2024-08-17T02:28:15.923288+0000","last_peered":"2024-08-17T02:28:15.923288+0000","last_clean":"2024-08-17T02:28:15.923288+0000","last_became_active":"2024-08-17T02:28:15.918200+0000","last_became_peered":"2024-08-17T02:28:15.918200+0000","last_unstale":"2024-08-17T02:28:15.923288+0000","last_undegraded":"2024-08-17T02:28:15.923288+0000","last_fullsized":"2024-08-17T02:28:15.923288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:08.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.892665+0000","last_change":"2024-08-17T02:28:14.900083+0000","last_active":"2024-08-17T02:28:15.892665+0000","last_peered":"2024-08-17T02:28:15.892665+0000","last_clean":"2024-08-17T02:28:15.892665+0000","last_became_active":"2024-08-17T02:28:14.899726+0000","last_became_peered":"2024-08-17T02:28:14.899726+0000","last_unstale":"2024-08-17T02:28:15.892665+0000","last_undegraded":"2024-08-17T02:28:15.892665+0000","last_fullsized":"2024-08-17T02:28:15.892665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:33.261147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906543+0000","last_change":"2024-08-17T02:28:15.902203+0000","last_active":"2024-08-17T02:28:15.906543+0000","last_peered":"2024-08-17T02:28:15.906543+0000","last_clean":"2024-08-17T02:28:15.906543+0000","last_became_active":"2024-08-17T02:28:15.901896+0000","last_became_peered":"2024-08-17T02:28:15.901896+0000","last_unstale":"2024-08-17T02:28:15.906543+0000","last_undegraded":"2024-08-17T02:28:15.906543+0000","last_fullsized":"2024-08-17T02:28:15.906543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:21.159860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.886982+0000","last_change":"2024-08-17T02:28:14.902315+0000","last_active":"2024-08-17T02:28:15.886982+0000","last_peered":"2024-08-17T02:28:15.886982+0000","last_clean":"2024-08-17T02:28:15.886982+0000","last_became_active":"2024-08-17T02:28:14.901379+0000","last_became_peered":"2024-08-17T02:28:14.901379+0000","last_unstale":"2024-08-17T02:28:15.886982+0000","last_undegraded":"2024-08-17T02:28:15.886982+0000","last_fullsized":"2024-08-17T02:28:15.886982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:55.825420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928523+0000","last_change":"2024-08-17T02:28:15.924721+0000","last_active":"2024-08-17T02:28:15.928523+0000","last_peered":"2024-08-17T02:28:15.928523+0000","last_clean":"2024-08-17T02:28:15.928523+0000","last_became_active":"2024-08-17T02:28:15.916201+0000","last_became_peered":"2024-08-17T02:28:15.916201+0000","last_unstale":"2024-08-17T02:28:15.928523+0000","last_undegraded":"2024-08-17T02:28:15.928523+0000","last_fullsized":"2024-08-17T02:28:15.928523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:08:27.093404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.926153+0000","last_change":"2024-08-17T02:28:14.900061+0000","last_active":"2024-08-17T02:28:15.926153+0000","last_peered":"2024-08-17T02:28:15.926153+0000","last_clean":"2024-08-17T02:28:15.926153+0000","last_became_active":"2024-08-17T02:28:14.899756+0000","last_became_peered":"2024-08-17T02:28:14.899756+0000","last_unstale":"2024-08-17T02:28:15.926153+0000","last_undegraded":"2024-08-17T02:28:15.926153+0000","last_fullsized":"2024-08-17T02:28:15.926153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:09.321766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.925552+0000","last_change":"2024-08-17T02:28:15.921239+0000","last_active":"2024-08-17T02:28:15.925552+0000","last_peered":"2024-08-17T02:28:15.925552+0000","last_clean":"2024-08-17T02:28:15.925552+0000","last_became_active":"2024-08-17T02:28:15.920907+0000","last_became_peered":"2024-08-17T02:28:15.920907+0000","last_unstale":"2024-08-17T02:28:15.925552+0000","last_undegraded":"2024-08-17T02:28:15.925552+0000","last_fullsized":"2024-08-17T02:28:15.925552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:30.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.931975+0000","last_change":"2024-08-17T02:28:14.901651+0000","last_active":"2024-08-17T02:28:15.931975+0000","last_peered":"2024-08-17T02:28:15.931975+0000","last_clean":"2024-08-17T02:28:15.931975+0000","last_became_active":"2024-08-17T02:28:14.901383+0000","last_became_peered":"2024-08-17T02:28:14.901383+0000","last_unstale":"2024-08-17T02:28:15.931975+0000","last_undegraded":"2024-08-17T02:28:15.931975+0000","last_fullsized":"2024-08-17T02:28:15.931975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:26.903646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906834+0000","last_change":"2024-08-17T02:28:15.901682+0000","last_active":"2024-08-17T02:28:15.906834+0000","last_peered":"2024-08-17T02:28:15.906834+0000","last_clean":"2024-08-17T02:28:15.906834+0000","last_became_active":"2024-08-17T02:28:15.901417+0000","last_became_peered":"2024-08-17T02:28:15.901417+0000","last_unstale":"2024-08-17T02:28:15.906834+0000","last_undegraded":"2024-08-17T02:28:15.906834+0000","last_fullsized":"2024-08-17T02:28:15.906834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:13.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929613+0000","last_change":"2024-08-17T02:28:14.888851+0000","last_active":"2024-08-17T02:28:15.929613+0000","last_peered":"2024-08-17T02:28:15.929613+0000","last_clean":"2024-08-17T02:28:15.929613+0000","last_became_active":"2024-08-17T02:28:14.888006+0000","last_became_peered":"2024-08-17T02:28:14.888006+0000","last_unstale":"2024-08-17T02:28:15.929613+0000","last_undegraded":"2024-08-17T02:28:15.929613+0000","last_fullsized":"2024-08-17T02:28:15.929613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:14:08.476080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.927821+0000","last_change":"2024-08-17T02:28:15.915310+0000","last_active":"2024-08-17T02:28:15.927821+0000","last_peered":"2024-08-17T02:28:15.927821+0000","last_clean":"2024-08-17T02:28:15.927821+0000","last_became_active":"2024-08-17T02:28:15.915047+0000","last_became_peered":"2024-08-17T02:28:15.915047+0000","last_unstale":"2024-08-17T02:28:15.927821+0000","last_undegraded":"2024-08-17T02:28:15.927821+0000","last_fullsized":"2024-08-17T02:28:15.927821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:12:13.834074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890185+0000","last_change":"2024-08-17T02:28:14.893716+0000","last_active":"2024-08-17T02:28:15.890185+0000","last_peered":"2024-08-17T02:28:15.890185+0000","last_clean":"2024-08-17T02:28:15.890185+0000","last_became_active":"2024-08-17T02:28:14.893460+0000","last_became_peered":"2024-08-17T02:28:14.893460+0000","last_unstale":"2024-08-17T02:28:15.890185+0000","last_undegraded":"2024-08-17T02:28:15.890185+0000","last_fullsized":"2024-08-17T02:28:15.890185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:18.398070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921019+0000","last_change":"2024-08-17T02:28:15.913281+0000","last_active":"2024-08-17T02:28:15.921019+0000","last_peered":"2024-08-17T02:28:15.921019+0000","last_clean":"2024-08-17T02:28:15.921019+0000","last_became_active":"2024-08-17T02:28:15.912396+0000","last_became_peered":"2024-08-17T02:28:15.912396+0000","last_unstale":"2024-08-17T02:28:15.921019+0000","last_undegraded":"2024-08-17T02:28:15.921019+0000","last_fullsized":"2024-08-17T02:28:15.921019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:04.378229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890761+0000","last_change":"2024-08-17T02:28:14.900239+0000","last_active":"2024-08-17T02:28:15.890761+0000","last_peered":"2024-08-17T02:28:15.890761+0000","last_clean":"2024-08-17T02:28:15.890761+0000","last_became_active":"2024-08-17T02:28:14.899989+0000","last_became_peered":"2024-08-17T02:28:14.899989+0000","last_unstale":"2024-08-17T02:28:15.890761+0000","last_undegraded":"2024-08-17T02:28:15.890761+0000","last_fullsized":"2024-08-17T02:28:15.890761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:10:04.691182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.920205+0000","last_change":"2024-08-17T02:28:15.911863+0000","last_active":"2024-08-17T02:28:15.920205+0000","last_peered":"2024-08-17T02:28:15.920205+0000","last_clean":"2024-08-17T02:28:15.920205+0000","last_became_active":"2024-08-17T02:28:15.911519+0000","last_became_peered":"2024-08-17T02:28:15.911519+0000","last_unstale":"2024-08-17T02:28:15.920205+0000","last_undegraded":"2024-08-17T02:28:15.920205+0000","last_fullsized":"2024-08-17T02:28:15.920205+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:09.415021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929208+0000","last_change":"2024-08-17T02:28:14.900780+0000","last_active":"2024-08-17T02:28:15.929208+0000","last_peered":"2024-08-17T02:28:15.929208+0000","last_clean":"2024-08-17T02:28:15.929208+0000","last_became_active":"2024-08-17T02:28:14.899289+0000","last_became_peered":"2024-08-17T02:28:14.899289+0000","last_unstale":"2024-08-17T02:28:15.929208+0000","last_undegraded":"2024-08-17T02:28:15.929208+0000","last_fullsized":"2024-08-17T02:28:15.929208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:08.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.918531+0000","last_change":"2024-08-17T02:28:15.914126+0000","last_active":"2024-08-17T02:28:15.918531+0000","last_peered":"2024-08-17T02:28:15.918531+0000","last_clean":"2024-08-17T02:28:15.918531+0000","last_became_active":"2024-08-17T02:28:15.913815+0000","last_became_peered":"2024-08-17T02:28:15.913815+0000","last_unstale":"2024-08-17T02:28:15.918531+0000","last_undegraded":"2024-08-17T02:28:15.918531+0000","last_fullsized":"2024-08-17T02:28:15.918531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:10.328072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.930707+0000","last_change":"2024-08-17T02:28:14.900578+0000","last_active":"2024-08-17T02:28:15.930707+0000","last_peered":"2024-08-17T02:28:15.930707+0000","last_clean":"2024-08-17T02:28:15.930707+0000","last_became_active":"2024-08-17T02:28:14.900312+0000","last_became_peered":"2024-08-17T02:28:14.900312+0000","last_unstale":"2024-08-17T02:28:15.930707+0000","last_undegraded":"2024-08-17T02:28:15.930707+0000","last_fullsized":"2024-08-17T02:28:15.930707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:37:27.642301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.919203+0000","last_change":"2024-08-17T02:28:15.912751+0000","last_active":"2024-08-17T02:28:15.919203+0000","last_peered":"2024-08-17T02:28:15.919203+0000","last_clean":"2024-08-17T02:28:15.919203+0000","last_became_active":"2024-08-17T02:28:15.911398+0000","last_became_peered":"2024-08-17T02:28:15.911398+0000","last_unstale":"2024-08-17T02:28:15.919203+0000","last_undegraded":"2024-08-17T02:28:15.919203+0000","last_fullsized":"2024-08-17T02:28:15.919203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:49:08.593518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928346+0000","last_change":"2024-08-17T02:28:14.888024+0000","last_active":"2024-08-17T02:28:15.928346+0000","last_peered":"2024-08-17T02:28:15.928346+0000","last_clean":"2024-08-17T02:28:15.928346+0000","last_became_active":"2024-08-17T02:28:14.887467+0000","last_became_peered":"2024-08-17T02:28:14.887467+0000","last_unstale":"2024-08-17T02:28:15.928346+0000","last_undegraded":"2024-08-17T02:28:15.928346+0000","last_fullsized":"2024-08-17T02:28:15.928346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:55.958215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928051+0000","last_change":"2024-08-17T02:28:15.923239+0000","last_active":"2024-08-17T02:28:15.928051+0000","last_peered":"2024-08-17T02:28:15.928051+0000","last_clean":"2024-08-17T02:28:15.928051+0000","last_became_active":"2024-08-17T02:28:15.919511+0000","last_became_peered":"2024-08-17T02:28:15.919511+0000","last_unstale":"2024-08-17T02:28:15.928051+0000","last_undegraded":"2024-08-17T02:28:15.928051+0000","last_fullsized":"2024-08-17T02:28:15.928051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:12.965709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928425+0000","last_change":"2024-08-17T02:28:14.897917+0000","last_active":"2024-08-17T02:28:15.928425+0000","last_peered":"2024-08-17T02:28:15.928425+0000","last_clean":"2024-08-17T02:28:15.928425+0000","last_became_active":"2024-08-17T02:28:14.895928+0000","last_became_peered":"2024-08-17T02:28:14.895928+0000","last_unstale":"2024-08-17T02:28:15.928425+0000","last_undegraded":"2024-08-17T02:28:15.928425+0000","last_fullsized":"2024-08-17T02:28:15.928425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:26.505495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.909175+0000","last_change":"2024-08-17T02:28:15.903045+0000","last_active":"2024-08-17T02:28:15.909175+0000","last_peered":"2024-08-17T02:28:15.909175+0000","last_clean":"2024-08-17T02:28:15.909175+0000","last_became_active":"2024-08-17T02:28:15.902807+0000","last_became_peered":"2024-08-17T02:28:15.902807+0000","last_unstale":"2024-08-17T02:28:15.909175+0000","last_undegraded":"2024-08-17T02:28:15.909175+0000","last_fullsized":"2024-08-17T02:28:15.909175+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:46.795770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905183+0000","last_change":"2024-08-17T02:28:14.889362+0000","last_active":"2024-08-17T02:28:15.905183+0000","last_peered":"2024-08-17T02:28:15.905183+0000","last_clean":"2024-08-17T02:28:15.905183+0000","last_became_active":"2024-08-17T02:28:14.888703+0000","last_became_peered":"2024-08-17T02:28:14.888703+0000","last_unstale":"2024-08-17T02:28:15.905183+0000","last_undegraded":"2024-08-17T02:28:15.905183+0000","last_fullsized":"2024-08-17T02:28:15.905183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:18.398070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.916816+0000","last_change":"2024-08-17T02:28:15.913947+0000","last_active":"2024-08-17T02:28:15.916816+0000","last_peered":"2024-08-17T02:28:15.916816+0000","last_clean":"2024-08-17T02:28:15.916816+0000","last_became_active":"2024-08-17T02:28:15.913590+0000","last_became_peered":"2024-08-17T02:28:15.913590+0000","last_unstale":"2024-08-17T02:28:15.916816+0000","last_undegraded":"2024-08-17T02:28:15.916816+0000","last_fullsized":"2024-08-17T02:28:15.916816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:02:52.769676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929431+0000","last_change":"2024-08-17T02:28:14.893726+0000","last_active":"2024-08-17T02:28:15.929431+0000","last_peered":"2024-08-17T02:28:15.929431+0000","last_clean":"2024-08-17T02:28:15.929431+0000","last_became_active":"2024-08-17T02:28:14.893422+0000","last_became_peered":"2024-08-17T02:28:14.893422+0000","last_unstale":"2024-08-17T02:28:15.929431+0000","last_undegraded":"2024-08-17T02:28:15.929431+0000","last_fullsized":"2024-08-17T02:28:15.929431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:08.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.908987+0000","last_change":"2024-08-17T02:28:15.902652+0000","last_active":"2024-08-17T02:28:15.908987+0000","last_peered":"2024-08-17T02:28:15.908987+0000","last_clean":"2024-08-17T02:28:15.908987+0000","last_became_active":"2024-08-17T02:28:15.901634+0000","last_became_peered":"2024-08-17T02:28:15.901634+0000","last_unstale":"2024-08-17T02:28:15.908987+0000","last_undegraded":"2024-08-17T02:28:15.908987+0000","last_fullsized":"2024-08-17T02:28:15.908987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:33.368526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.899307+0000","last_change":"2024-08-17T02:28:14.896200+0000","last_active":"2024-08-17T02:28:15.899307+0000","last_peered":"2024-08-17T02:28:15.899307+0000","last_clean":"2024-08-17T02:28:15.899307+0000","last_became_active":"2024-08-17T02:28:14.895922+0000","last_became_peered":"2024-08-17T02:28:14.895922+0000","last_unstale":"2024-08-17T02:28:15.899307+0000","last_undegraded":"2024-08-17T02:28:15.899307+0000","last_fullsized":"2024-08-17T02:28:15.899307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:17.427818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.906677+0000","last_change":"2024-08-17T02:28:15.899699+0000","last_active":"2024-08-17T02:28:15.906677+0000","last_peered":"2024-08-17T02:28:15.906677+0000","last_clean":"2024-08-17T02:28:15.906677+0000","last_became_active":"2024-08-17T02:28:15.898966+0000","last_became_peered":"2024-08-17T02:28:15.898966+0000","last_unstale":"2024-08-17T02:28:15.906677+0000","last_undegraded":"2024-08-17T02:28:15.906677+0000","last_fullsized":"2024-08-17T02:28:15.906677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:56.964520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905080+0000","last_change":"2024-08-17T02:28:14.893286+0000","last_active":"2024-08-17T02:28:15.905080+0000","last_peered":"2024-08-17T02:28:15.905080+0000","last_clean":"2024-08-17T02:28:15.905080+0000","last_became_active":"2024-08-17T02:28:14.892997+0000","last_became_peered":"2024-08-17T02:28:14.892997+0000","last_unstale":"2024-08-17T02:28:15.905080+0000","last_undegraded":"2024-08-17T02:28:15.905080+0000","last_fullsized":"2024-08-17T02:28:15.905080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:32.362221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.915772+0000","last_change":"2024-08-17T02:28:15.908753+0000","last_active":"2024-08-17T02:28:15.915772+0000","last_peered":"2024-08-17T02:28:15.915772+0000","last_clean":"2024-08-17T02:28:15.915772+0000","last_became_active":"2024-08-17T02:28:15.908477+0000","last_became_peered":"2024-08-17T02:28:15.908477+0000","last_unstale":"2024-08-17T02:28:15.915772+0000","last_undegraded":"2024-08-17T02:28:15.915772+0000","last_fullsized":"2024-08-17T02:28:15.915772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:21:08.224658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.894184+0000","last_change":"2024-08-17T02:28:14.897474+0000","last_active":"2024-08-17T02:28:15.894184+0000","last_peered":"2024-08-17T02:28:15.894184+0000","last_clean":"2024-08-17T02:28:15.894184+0000","last_became_active":"2024-08-17T02:28:14.897166+0000","last_became_peered":"2024-08-17T02:28:14.897166+0000","last_unstale":"2024-08-17T02:28:15.894184+0000","last_undegraded":"2024-08-17T02:28:15.894184+0000","last_fullsized":"2024-08-17T02:28:15.894184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:28:33.261147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.910673+0000","last_change":"2024-08-17T02:28:15.908014+0000","last_active":"2024-08-17T02:28:15.910673+0000","last_peered":"2024-08-17T02:28:15.910673+0000","last_clean":"2024-08-17T02:28:15.910673+0000","last_became_active":"2024-08-17T02:28:15.907562+0000","last_became_peered":"2024-08-17T02:28:15.907562+0000","last_unstale":"2024-08-17T02:28:15.910673+0000","last_undegraded":"2024-08-17T02:28:15.910673+0000","last_fullsized":"2024-08-17T02:28:15.910673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:07:20.519228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.929942+0000","last_change":"2024-08-17T02:28:14.893869+0000","last_active":"2024-08-17T02:28:15.929942+0000","last_peered":"2024-08-17T02:28:15.929942+0000","last_clean":"2024-08-17T02:28:15.929942+0000","last_became_active":"2024-08-17T02:28:14.893542+0000","last_became_peered":"2024-08-17T02:28:14.893542+0000","last_unstale":"2024-08-17T02:28:15.929942+0000","last_undegraded":"2024-08-17T02:28:15.929942+0000","last_fullsized":"2024-08-17T02:28:15.929942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:49:45.789464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.919225+0000","last_change":"2024-08-17T02:28:15.913633+0000","last_active":"2024-08-17T02:28:15.919225+0000","last_peered":"2024-08-17T02:28:15.919225+0000","last_clean":"2024-08-17T02:28:15.919225+0000","last_became_active":"2024-08-17T02:28:15.913355+0000","last_became_peered":"2024-08-17T02:28:15.913355+0000","last_unstale":"2024-08-17T02:28:15.919225+0000","last_undegraded":"2024-08-17T02:28:15.919225+0000","last_fullsized":"2024-08-17T02:28:15.919225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:21.159860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:28:17.158903+0000","last_change":"2024-08-17T02:28:14.897947+0000","last_active":"2024-08-17T02:28:17.158903+0000","last_peered":"2024-08-17T02:28:17.158903+0000","last_clean":"2024-08-17T02:28:17.158903+0000","last_became_active":"2024-08-17T02:28:14.897681+0000","last_became_peered":"2024-08-17T02:28:14.897681+0000","last_unstale":"2024-08-17T02:28:17.158903+0000","last_undegraded":"2024-08-17T02:28:17.158903+0000","last_fullsized":"2024-08-17T02:28:17.158903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:21:26.903646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.921100+0000","last_change":"2024-08-17T02:28:15.919843+0000","last_active":"2024-08-17T02:28:15.921100+0000","last_peered":"2024-08-17T02:28:15.921100+0000","last_clean":"2024-08-17T02:28:15.921100+0000","last_became_active":"2024-08-17T02:28:15.919503+0000","last_became_peered":"2024-08-17T02:28:15.919503+0000","last_unstale":"2024-08-17T02:28:15.921100+0000","last_undegraded":"2024-08-17T02:28:15.921100+0000","last_fullsized":"2024-08-17T02:28:15.921100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:13:05.262035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890002+0000","last_change":"2024-08-17T02:28:14.895084+0000","last_active":"2024-08-17T02:28:15.890002+0000","last_peered":"2024-08-17T02:28:15.890002+0000","last_clean":"2024-08-17T02:28:15.890002+0000","last_became_active":"2024-08-17T02:28:14.894818+0000","last_became_peered":"2024-08-17T02:28:14.894818+0000","last_unstale":"2024-08-17T02:28:15.890002+0000","last_undegraded":"2024-08-17T02:28:15.890002+0000","last_fullsized":"2024-08-17T02:28:15.890002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:17.427818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.907515+0000","last_change":"2024-08-17T02:28:15.900606+0000","last_active":"2024-08-17T02:28:15.907515+0000","last_peered":"2024-08-17T02:28:15.907515+0000","last_clean":"2024-08-17T02:28:15.907515+0000","last_became_active":"2024-08-17T02:28:15.900316+0000","last_became_peered":"2024-08-17T02:28:15.900316+0000","last_unstale":"2024-08-17T02:28:15.907515+0000","last_undegraded":"2024-08-17T02:28:15.907515+0000","last_fullsized":"2024-08-17T02:28:15.907515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:10.328072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.886494+0000","last_change":"2024-08-17T02:28:14.889270+0000","last_active":"2024-08-17T02:28:15.886494+0000","last_peered":"2024-08-17T02:28:15.886494+0000","last_clean":"2024-08-17T02:28:15.886494+0000","last_became_active":"2024-08-17T02:28:14.888994+0000","last_became_peered":"2024-08-17T02:28:14.888994+0000","last_unstale":"2024-08-17T02:28:15.886494+0000","last_undegraded":"2024-08-17T02:28:15.886494+0000","last_fullsized":"2024-08-17T02:28:15.886494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:03:41.416641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.918752+0000","last_change":"2024-08-17T02:28:15.906447+0000","last_active":"2024-08-17T02:28:15.918752+0000","last_peered":"2024-08-17T02:28:15.918752+0000","last_clean":"2024-08-17T02:28:15.918752+0000","last_became_active":"2024-08-17T02:28:15.906139+0000","last_became_peered":"2024-08-17T02:28:15.906139+0000","last_unstale":"2024-08-17T02:28:15.918752+0000","last_undegraded":"2024-08-17T02:28:15.918752+0000","last_fullsized":"2024-08-17T02:28:15.918752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:29:37.364500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890434+0000","last_change":"2024-08-17T02:28:14.899368+0000","last_active":"2024-08-17T02:28:15.890434+0000","last_peered":"2024-08-17T02:28:15.890434+0000","last_clean":"2024-08-17T02:28:15.890434+0000","last_became_active":"2024-08-17T02:28:14.897556+0000","last_became_peered":"2024-08-17T02:28:14.897556+0000","last_unstale":"2024-08-17T02:28:15.890434+0000","last_undegraded":"2024-08-17T02:28:15.890434+0000","last_fullsized":"2024-08-17T02:28:15.890434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:03:41.416641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.900218+0000","last_change":"2024-08-17T02:28:15.896389+0000","last_active":"2024-08-17T02:28:15.900218+0000","last_peered":"2024-08-17T02:28:15.900218+0000","last_clean":"2024-08-17T02:28:15.900218+0000","last_became_active":"2024-08-17T02:28:15.896144+0000","last_became_peered":"2024-08-17T02:28:15.896144+0000","last_unstale":"2024-08-17T02:28:15.900218+0000","last_undegraded":"2024-08-17T02:28:15.900218+0000","last_fullsized":"2024-08-17T02:28:15.900218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:39:30.658846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.905182+0000","last_change":"2024-08-17T02:28:14.883518+0000","last_active":"2024-08-17T02:28:15.905182+0000","last_peered":"2024-08-17T02:28:15.905182+0000","last_clean":"2024-08-17T02:28:15.905182+0000","last_became_active":"2024-08-17T02:28:14.883142+0000","last_became_peered":"2024-08-17T02:28:14.883142+0000","last_unstale":"2024-08-17T02:28:15.905182+0000","last_undegraded":"2024-08-17T02:28:15.905182+0000","last_fullsized":"2024-08-17T02:28:15.905182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:26.108292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.928196+0000","last_change":"2024-08-17T02:28:15.921411+0000","last_active":"2024-08-17T02:28:15.928196+0000","last_peered":"2024-08-17T02:28:15.928196+0000","last_clean":"2024-08-17T02:28:15.928196+0000","last_became_active":"2024-08-17T02:28:15.921140+0000","last_became_peered":"2024-08-17T02:28:15.921140+0000","last_unstale":"2024-08-17T02:28:15.928196+0000","last_undegraded":"2024-08-17T02:28:15.928196+0000","last_fullsized":"2024-08-17T02:28:15.928196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:06:50.209582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.890838+0000","last_change":"2024-08-17T02:28:14.900563+0000","last_active":"2024-08-17T02:28:15.890838+0000","last_peered":"2024-08-17T02:28:15.890838+0000","last_clean":"2024-08-17T02:28:15.890838+0000","last_became_active":"2024-08-17T02:28:14.900324+0000","last_became_peered":"2024-08-17T02:28:14.900324+0000","last_unstale":"2024-08-17T02:28:15.890838+0000","last_undegraded":"2024-08-17T02:28:15.890838+0000","last_fullsized":"2024-08-17T02:28:15.890838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:09.321766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.924204+0000","last_change":"2024-08-17T02:28:15.914819+0000","last_active":"2024-08-17T02:28:15.924204+0000","last_peered":"2024-08-17T02:28:15.924204+0000","last_clean":"2024-08-17T02:28:15.924204+0000","last_became_active":"2024-08-17T02:28:15.914560+0000","last_became_peered":"2024-08-17T02:28:15.914560+0000","last_unstale":"2024-08-17T02:28:15.924204+0000","last_undegraded":"2024-08-17T02:28:15.924204+0000","last_fullsized":"2024-08-17T02:28:15.924204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:14.868661+0000","last_clean_scrub_stamp":"2024-08-17T02:28:14.868661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:06:50.653016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.897589+0000","last_change":"2024-08-17T02:28:14.896777+0000","last_active":"2024-08-17T02:28:15.897589+0000","last_peered":"2024-08-17T02:28:15.897589+0000","last_clean":"2024-08-17T02:28:15.897589+0000","last_became_active":"2024-08-17T02:28:14.893970+0000","last_became_peered":"2024-08-17T02:28:14.893970+0000","last_unstale":"2024-08-17T02:28:15.897589+0000","last_undegraded":"2024-08-17T02:28:15.897589+0000","last_fullsized":"2024-08-17T02:28:15.897589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:13.862355+0000","last_clean_scrub_stamp":"2024-08-17T02:28:13.862355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:27:18.398070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:15.895299+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:28:15.895299+0000","last_peered":"2024-08-17T02:28:15.895299+0000","last_clean":"2024-08-17T02:28:15.895299+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:28:15.895299+0000","last_undegraded":"2024-08-17T02:28:15.895299+0000","last_fullsized":"2024-08-17T02:28:15.895299+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298296,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073544,"statfs":{"total":96636764160,"available":96331309056,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:20.501 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:28:20.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:28:20.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.694+0000 7efeb5e00640 1 Processor -- start 2024-08-17T02:28:20.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.694+0000 7efeb5e00640 1 -- start start 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.695+0000 7efeb5e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00affe0 0x7efeb0160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.695+0000 7efeb5e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00c9200 con 0x7efeb01556e0 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.695+0000 7efeb5e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00c8bf0 con 0x7efeb0155ab0 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.695+0000 7efeb5e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0159ef0 con 0x7efeb00affe0 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeb4a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7efeb01556e0 0x7efeb01594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43850/0 (socket says 172.21.15.42:43850) 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeb4a00640 1 -- 172.21.15.42:0/2566932518 learned_addr learned my addr 172.21.15.42:0/2566932518 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeb5400640 1 --2- 172.21.15.42:0/2566932518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00affe0 0x7efeb0160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709851321 0 0) 0x7efeb00c9200 con 0x7efeb01556e0 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe980034e0 con 0x7efeb01556e0 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868302835 0 0) 0x7efeb00c8bf0 con 0x7efeb0155ab0 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb00c9200 con 0x7efeb0155ab0 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeb5400640 1 -- 172.21.15.42:0/2566932518 >> v1:172.21.15.62:6789/0 conn(0x7efeb0155ab0 legacy=0x7efeb00af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeb5400640 1 -- 172.21.15.42:0/2566932518 >> v1:172.21.15.42:6789/0 conn(0x7efeb01556e0 legacy=0x7efeb01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.696+0000 7efeb5400640 1 -- 172.21.15.42:0/2566932518 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb015a1d0 con 0x7efeb00affe0 2024-08-17T02:28:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.697+0000 7efeb5400640 1 --2- 172.21.15.42:0/2566932518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00affe0 0x7efeb0160840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efea8009e90 tx=0x7efea8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b490c4e2469b9761 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8007550 con 0x7efeb00affe0 2024-08-17T02:28:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea802d050 con 0x7efeb00affe0 2024-08-17T02:28:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeaf400640 1 -- 172.21.15.42:0/2566932518 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea80078e0 con 0x7efeb00affe0 2024-08-17T02:28:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 -- 172.21.15.42:0/2566932518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00affe0 msgr2=0x7efeb0160840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 --2- 172.21.15.42:0/2566932518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00affe0 0x7efeb0160840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efea8009e90 tx=0x7efea8009780 comp rx=0 tx=0).stop 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 -- 172.21.15.42:0/2566932518 shutdown_connections 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 --2- 172.21.15.42:0/2566932518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb00affe0 0x7efeb0160840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 -- 172.21.15.42:0/2566932518 >> 172.21.15.42:0/2566932518 conn(0x7efeb0066e60 msgr2=0x7efeb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 -- 172.21.15.42:0/2566932518 shutdown_connections 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.698+0000 7efeb5e00640 1 -- 172.21.15.42:0/2566932518 wait complete. 2024-08-17T02:28:20.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.700+0000 7efeb5e00640 1 Processor -- start 2024-08-17T02:28:20.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.700+0000 7efeb5e00640 1 -- start start 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00affe0 0x7efeb0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb01556e0 0x7efeb0151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 0x7efeb0152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb00c7fd0 con 0x7efeb0155ab0 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0152640 con 0x7efeb00affe0 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0152920 con 0x7efeb01556e0 2024-08-17T02:28:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 0x7efeb0152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb4a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00affe0 0x7efeb0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeafe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb01556e0 0x7efeb0151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 0x7efeb0152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34074/0 (socket says 172.21.15.42:34074) 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.701+0000 7efeb5400640 1 -- 172.21.15.42:0/3731947387 learned_addr learned my addr 172.21.15.42:0/3731947387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeafe00640 1 -- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00affe0 msgr2=0x7efeb0150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeafe00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00affe0 0x7efeb0150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeafe00640 1 -- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 msgr2=0x7efeb0152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeafe00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 0x7efeb0152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeafe00640 1 -- 172.21.15.42:0/3731947387 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8009a20 con 0x7efeb01556e0 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeb5400640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 0x7efeb0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeafe00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb01556e0 0x7efeb0151ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c3f0 tx=0x7efe9c007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c011590 con 0x7efeb01556e0 2024-08-17T02:28:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c011710 con 0x7efeb01556e0 2024-08-17T02:28:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c011ad0 con 0x7efeb01556e0 2024-08-17T02:28:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb0152c00 con 0x7efeb01556e0 2024-08-17T02:28:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.702+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb0150ad0 con 0x7efeb01556e0 2024-08-17T02:28:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.703+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0155fa0 con 0x7efeb01556e0 2024-08-17T02:28:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.704+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efe9c01c460 con 0x7efeb01556e0 2024-08-17T02:28:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.705+0000 7efea3e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efe90065150 0x7efe90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.705+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe9c081fb0 con 0x7efeb01556e0 2024-08-17T02:28:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.705+0000 7efeb4a00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efe90065150 0x7efe90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.706+0000 7efeb4a00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efe90065150 0x7efe90067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efea4005840 tx=0x7efea4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.710+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efeb0155fa0 con 0x7efeb01556e0 2024-08-17T02:28:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.962+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efeb0155fa0 con 0x7efeb01556e0 2024-08-17T02:28:20.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.966+0000 7efea3e00640 1 -- 172.21.15.42:0/3731947387 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7efeb0155fa0 con 0x7efeb01556e0 2024-08-17T02:28:20.966 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-08-17T02:28:20.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efe90065150 msgr2=0x7efe90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efe90065150 0x7efe90067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efea4005840 tx=0x7efea4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb01556e0 msgr2=0x7efeb0151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb01556e0 0x7efeb0151ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c3f0 tx=0x7efe9c007cc0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 shutdown_connections 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7efe90065150 0x7efe90067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeb0155ab0 0x7efeb0152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efeb01556e0 0x7efeb0151ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 --2- 172.21.15.42:0/3731947387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efeb00affe0 0x7efeb0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 >> 172.21.15.42:0/3731947387 conn(0x7efeb0066e60 msgr2=0x7efeb01510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 shutdown_connections 2024-08-17T02:28:20.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:20.968+0000 7efeb5e00640 1 -- 172.21.15.42:0/3731947387 wait complete. 2024-08-17T02:28:20.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.133+0000 7f52e9c00640 1 Processor -- start 2024-08-17T02:28:21.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.134+0000 7f52e9c00640 1 -- start start 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e9c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa8b0 0x7f52e40af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e9c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f52e40afe20 0x7f52e415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e9c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e406dba0 con 0x7f52e40aa4e0 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e9c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40aad00 con 0x7f52e40afe20 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e9c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e415d580 con 0x7f52e40aa8b0 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e9200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f52e40afe20 0x7f52e415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e3e00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f52e40aa4e0 0x7f52e406e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:39354/0 (socket says 172.21.15.42:39354) 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52e3e00640 1 -- 172.21.15.42:0/2082386486 learned_addr learned my addr 172.21.15.42:0/2082386486 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:21.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.135+0000 7f52dbe00640 1 --2- 172.21.15.42:0/2082386486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa8b0 0x7f52e40af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.136+0000 7f52e3400640 1 -- 172.21.15.42:0/2082386486 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659425982 0 0) 0x7f52e406dba0 con 0x7f52e40aa4e0 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.136+0000 7f52e3400640 1 -- 172.21.15.42:0/2082386486 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c80034e0 con 0x7f52e40aa4e0 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.136+0000 7f52e9200640 1 -- 172.21.15.42:0/2082386486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa8b0 msgr2=0x7f52e40af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.136+0000 7f52e9200640 1 --2- 172.21.15.42:0/2082386486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa8b0 0x7f52e40af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.136+0000 7f52e9200640 1 -- 172.21.15.42:0/2082386486 >> v1:172.21.15.62:6789/0 conn(0x7f52e40aa4e0 legacy=0x7f52e406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.136+0000 7f52e9200640 1 -- 172.21.15.42:0/2082386486 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e406ddf0 con 0x7f52e40afe20 2024-08-17T02:28:21.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.137+0000 7f52e9200640 1 --2- 172.21.15.42:0/2082386486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e415c810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e60 tx=0x7f52dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708741da3dcd52af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.137+0000 7f52e3400640 1 -- 172.21.15.42:0/2082386486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007550 con 0x7f52e40afe20 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.137+0000 7f52e3400640 1 -- 172.21.15.42:0/2082386486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc02d050 con 0x7f52e40afe20 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.137+0000 7f52e3400640 1 -- 172.21.15.42:0/2082386486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007900 con 0x7f52e40afe20 2024-08-17T02:28:21.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 -- 172.21.15.42:0/2082386486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 msgr2=0x7f52e415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 --2- 172.21.15.42:0/2082386486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e415c810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e60 tx=0x7f52dc009780 comp rx=0 tx=0).stop 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 -- 172.21.15.42:0/2082386486 shutdown_connections 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 --2- 172.21.15.42:0/2082386486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e415c810 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 --2- 172.21.15.42:0/2082386486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa8b0 0x7f52e40af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 -- 172.21.15.42:0/2082386486 >> 172.21.15.42:0/2082386486 conn(0x7f52e4066e60 msgr2=0x7f52e4067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 -- 172.21.15.42:0/2082386486 shutdown_connections 2024-08-17T02:28:21.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.138+0000 7f52e9c00640 1 -- 172.21.15.42:0/2082386486 wait complete. 2024-08-17T02:28:21.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.139+0000 7f52e9c00640 1 Processor -- start 2024-08-17T02:28:21.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.139+0000 7f52e9c00640 1 -- start start 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 0x7f52e4168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e40aa8b0 0x7f52e40acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e413b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4159210 con 0x7f52e40afe20 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e41597d0 con 0x7f52e40aa8b0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e415ce10 con 0x7f52e40aa4e0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 0x7f52e4168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e413b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e40aa8b0 0x7f52e40acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.140+0000 7f52e3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 0x7f52e4168dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54848/0 (socket says 172.21.15.42:54848) 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52e3e00640 1 -- 172.21.15.42:0/814210351 learned_addr learned my addr 172.21.15.42:0/814210351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52dbe00640 1 -- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 msgr2=0x7f52e4168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52dbe00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 0x7f52e4168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52dbe00640 1 -- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 msgr2=0x7f52e413b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52dbe00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e413b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52dbe00640 1 -- 172.21.15.42:0/814210351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc009a20 con 0x7f52e40aa8b0 2024-08-17T02:28:21.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52e3e00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 0x7f52e4168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52dbe00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e40aa8b0 0x7f52e40acef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e960 tx=0x7f52cc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.141+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc009540 con 0x7f52e40aa8b0 2024-08-17T02:28:21.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.142+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00c940 con 0x7f52e40aa8b0 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.142+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00ccc0 con 0x7f52e40aa8b0 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.142+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e415d0f0 con 0x7f52e40aa8b0 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.142+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e40ad980 con 0x7f52e40aa8b0 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.143+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e4159940 con 0x7f52e40aa8b0 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.143+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f52cc013680 con 0x7f52e40aa8b0 2024-08-17T02:28:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.144+0000 7f52db400640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f52c0065180 0x7f52c0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.144+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52cc082550 con 0x7f52e40aa8b0 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.144+0000 7f52e3e00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f52c0065180 0x7f52c0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.145+0000 7f52e3e00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f52c0065180 0x7f52c0067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52d40011e0 tx=0x7f52d4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.149+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f52cc0540b0 con 0x7f52e40aa8b0 2024-08-17T02:28:21.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.368+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52e4070720 con 0x7f52e40aa8b0 2024-08-17T02:28:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.370+0000 7f52db400640 1 -- 172.21.15.42:0/814210351 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f52cc053c40 con 0x7f52e40aa8b0 2024-08-17T02:28:21.370 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:21.370 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4739,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:15.308187+0000","modified":"2024-08-17T02:28:18.906436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4887},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4887":{"gid":4887,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6836/3869657839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3869657839},{"type":"v1","addr":"172.21.15.42:6836","nonce":3869657839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2024-08-17T02:28:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f52c0065180 msgr2=0x7f52c0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f52c0065180 0x7f52c0067630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f52d40011e0 tx=0x7f52d4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e40aa8b0 msgr2=0x7f52e40acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e40aa8b0 0x7f52e40acef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e960 tx=0x7f52cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 shutdown_connections 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f52c0065180 0x7f52c0067630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e40afe20 0x7f52e413b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52e40aa8b0 0x7f52e40acef0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 --2- 172.21.15.42:0/814210351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f52e40aa4e0 0x7f52e4168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 >> 172.21.15.42:0/814210351 conn(0x7f52e4066e60 msgr2=0x7f52e4069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 shutdown_connections 2024-08-17T02:28:21.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.372+0000 7f52e9c00640 1 -- 172.21.15.42:0/814210351 wait complete. 2024-08-17T02:28:21.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:28:15.308187+0000', 'modified': '2024-08-17T02:28:18.906436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4887}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4887': {'gid': 4887, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6836/3869657839', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 3869657839}, {'type': 'v1', 'addr': '172.21.15.42:6836', 'nonce': 3869657839}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:28:21.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:28:21.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:28:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.946+0000 7fab62000640 1 Processor -- start 2024-08-17T02:28:21.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.946+0000 7fab62000640 1 -- start start 2024-08-17T02:28:21.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.947+0000 7fab62000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fab5c0ca050 0x7fab5c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.947+0000 7fab62000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0add30 0x7fab5c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.947+0000 7fab62000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab5c15b5e0 con 0x7fab5c0ad960 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.947+0000 7fab62000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5c0cb160 con 0x7fab5c0ca050 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.947+0000 7fab62000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0b0d10 con 0x7fab5c0add30 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab5b400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fab5c0ad960 0x7fab5c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49050/0 (socket says 172.21.15.42:49050) 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab5b400640 1 -- 172.21.15.42:0/2211304141 learned_addr learned my addr 172.21.15.42:0/2211304141 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab53e00640 1 --2- 172.21.15.42:0/2211304141 >> v2:172.21.15.42:3300/0 conn(0x7fab5c0ca050 0x7fab5c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab5be00640 1 --2- 172.21.15.42:0/2211304141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0add30 0x7fab5c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab53e00640 1 -- 172.21.15.42:0/2211304141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0add30 msgr2=0x7fab5c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab53e00640 1 --2- 172.21.15.42:0/2211304141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0add30 0x7fab5c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab5aa00640 1 -- 172.21.15.42:0/2211304141 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815610707 0 0) 0x7fab4c001110 con 0x7fab5c0ad960 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab53e00640 1 -- 172.21.15.42:0/2211304141 >> v1:172.21.15.42:6789/0 conn(0x7fab5c0ad960 legacy=0x7fab5c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.948+0000 7fab53e00640 1 -- 172.21.15.42:0/2211304141 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c0ca550 con 0x7fab5c0ca050 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.949+0000 7fab53e00640 1 --2- 172.21.15.42:0/2211304141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c156b30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab44009850 tx=0x7fab440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80817f5569c576d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab5aa00640 1 -- 172.21.15.42:0/2211304141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4402ae10 con 0x7fab5c0ca050 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab5aa00640 1 -- 172.21.15.42:0/2211304141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44032440 con 0x7fab5c0ca050 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab5aa00640 1 -- 172.21.15.42:0/2211304141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440327e0 con 0x7fab5c0ca050 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 -- 172.21.15.42:0/2211304141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 msgr2=0x7fab5c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 --2- 172.21.15.42:0/2211304141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c156b30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fab44009850 tx=0x7fab440090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 -- 172.21.15.42:0/2211304141 shutdown_connections 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 --2- 172.21.15.42:0/2211304141 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0add30 0x7fab5c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 --2- 172.21.15.42:0/2211304141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c156b30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 -- 172.21.15.42:0/2211304141 >> 172.21.15.42:0/2211304141 conn(0x7fab5c066e60 msgr2=0x7fab5c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 -- 172.21.15.42:0/2211304141 shutdown_connections 2024-08-17T02:28:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.950+0000 7fab62000640 1 -- 172.21.15.42:0/2211304141 wait complete. 2024-08-17T02:28:21.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.952+0000 7fab62000640 1 Processor -- start 2024-08-17T02:28:21.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.952+0000 7fab62000640 1 -- start start 2024-08-17T02:28:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab62000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0ad960 0x7fab5c14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab62000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab5c0add30 0x7fab5c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab62000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab62000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0ace40 con 0x7fab5c0ca050 2024-08-17T02:28:21.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab62000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0ac880 con 0x7fab5c0add30 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab62000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c0acb60 con 0x7fab5c0ad960 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39008/0 (socket says 172.21.15.42:39008) 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 -- 172.21.15.42:0/3327073363 learned_addr learned my addr 172.21.15.42:0/3327073363 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5b400640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0ad960 0x7fab5c14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab53e00640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab5c0add30 0x7fab5c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 -- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0ad960 msgr2=0x7fab5c14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0ad960 0x7fab5c14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 -- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab5c0add30 msgr2=0x7fab5c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab5c0add30 0x7fab5c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.953+0000 7fab5be00640 1 -- 172.21.15.42:0/3327073363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44009390 con 0x7fab5c0ca050 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.954+0000 7fab5be00640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c1536f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab54009fa0 tx=0x7fab54009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.954+0000 7fab52a00640 1 -- 172.21.15.42:0/3327073363 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5400ee60 con 0x7fab5c0ca050 2024-08-17T02:28:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.954+0000 7fab52a00640 1 -- 172.21.15.42:0/3327073363 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54014420 con 0x7fab5c0ca050 2024-08-17T02:28:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.954+0000 7fab52a00640 1 -- 172.21.15.42:0/3327073363 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540147e0 con 0x7fab5c0ca050 2024-08-17T02:28:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.954+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c0a8c00 con 0x7fab5c0ca050 2024-08-17T02:28:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.954+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c14b7a0 con 0x7fab5c0ca050 2024-08-17T02:28:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.956+0000 7fab52a00640 1 -- 172.21.15.42:0/3327073363 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fab54014b50 con 0x7fab5c0ca050 2024-08-17T02:28:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.957+0000 7fab52a00640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab38065150 0x7fab38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.957+0000 7fab52a00640 1 -- 172.21.15.42:0/3327073363 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab54082d60 con 0x7fab5c0ca050 2024-08-17T02:28:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.957+0000 7fab5b400640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab38065150 0x7fab38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.957+0000 7fab64625740 1 Processor -- start 2024-08-17T02:28:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 -- start start 2024-08-17T02:28:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab5b400640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab38065150 0x7fab38067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab4c001800 tx=0x7fab4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c68e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c3d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928bfe380 con 0x55b928c440a0 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928ba79e0 con 0x55b928c86b10 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.958+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b928ba5170 con 0x55b928c68a30 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab5b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c68e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c865d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39022/0 (socket says 172.21.15.42:39022) 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 -- 172.21.15.42:0/3411742422 learned_addr learned my addr 172.21.15.42:0/3411742422 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab5b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c68e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54884/0 (socket says 172.21.15.42:54884) 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab5be00640 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c3d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 -- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 msgr2=0x55b928c68e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c68e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 -- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 msgr2=0x55b928c3d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c3d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 -- 172.21.15.42:0/3411742422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b928b54820 con 0x55b928c440a0 2024-08-17T02:28:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.959+0000 7fab53e00640 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c865d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab44009850 tx=0x7fab44032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fdcbfd68c22075 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab4b400640 1 -- 172.21.15.42:0/3411742422 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44000cc0 con 0x55b928c440a0 2024-08-17T02:28:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab4b400640 1 -- 172.21.15.42:0/3411742422 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440325b0 con 0x55b928c440a0 2024-08-17T02:28:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab4b400640 1 -- 172.21.15.42:0/3411742422 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4403d480 con 0x55b928c440a0 2024-08-17T02:28:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 -- 172.21.15.42:0/3411742422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 msgr2=0x55b928c865d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c865d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab44009850 tx=0x7fab44032000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 -- 172.21.15.42:0/3411742422 shutdown_connections 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c3d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c865d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 --2- 172.21.15.42:0/3411742422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c68e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 -- 172.21.15.42:0/3411742422 >> 172.21.15.42:0/3411742422 conn(0x55b928bdc030 msgr2=0x55b928c8ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 -- 172.21.15.42:0/3411742422 shutdown_connections 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.960+0000 7fab64625740 1 -- 172.21.15.42:0/3411742422 wait complete. 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.961+0000 7fab64625740 1 -- start start 2024-08-17T02:28:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.961+0000 7fab64625740 1 Processor -- start 2024-08-17T02:28:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c97900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c66f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928ba0f60 con 0x55b928c440a0 2024-08-17T02:28:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928b49690 con 0x55b928c86b10 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b928b49330 con 0x55b928c68a30 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.962+0000 7fab64625740 10 client.0 _ll_register_callbacks cb 0x55b928b432b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c97900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c97900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39032/0 (socket says 172.21.15.42:39032) 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 -- 172.21.15.42:0/4164689488 learned_addr learned my addr 172.21.15.42:0/4164689488 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab53e00640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c66f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5be00640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 -- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 msgr2=0x55b928c66f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c66f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 -- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 msgr2=0x55b928c844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c844c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 -- 172.21.15.42:0/4164689488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c0ca550 con 0x55b928c440a0 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab5b400640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c97900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab4c005b90 tx=0x7fab4c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7345e75e979bfb4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.963+0000 7fab3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab3fe00640 1 -- 172.21.15.42:0/4164689488 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c013420 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab3fe00640 1 -- 172.21.15.42:0/4164689488 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab4c023b10 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b928bd4d20 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab3fe00640 1 -- 172.21.15.42:0/4164689488 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab4c013580 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 10 client.5085 fetch_fsmap learned FSMap version 15 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b928b6aab0 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab3fe00640 1 -- 172.21.15.42:0/4164689488 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b928bd4d20 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab3fe00640 1 -- 172.21.15.42:0/4164689488 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fab4c020070 con 0x55b928c440a0 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 10 client.5085 fetch_fsmap finished waiting for FSMap version 15 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 10 client.5085 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 20 client.5085 populate_metadata read hostname 'smithi042' 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c65b50 0x55b928c65f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 4 client.5085 mds_command: new command op to 4887 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:28:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.964+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 --> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9288a83c0 con 0x55b928c65b50 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.965+0000 7fab53e00640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c65b50 0x55b928c65f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.965+0000 7fab53e00640 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c65b50 0x55b928c65f60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82c09a8a5afc47e server_cookie=af47e02d7280d6a3 in_seq=0 out_seq=0 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.965+0000 7fab3fe00640 10 client.5085 ms_handle_connect on v2:172.21.15.42:6834/3869657839 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab3fe00640 1 -- 172.21.15.42:0/4164689488 <== mds.0 v2:172.21.15.42:6834/3869657839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55b9288a83c0 con 0x55b928c65b50 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab3fe00640 10 client.5085 handle_command_reply: tid=0 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 client.5085 shutdown 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 msgr2=0x55b928c97900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c97900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab4c005b90 tx=0x7fab4c013000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 shutdown_connections 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c65b50 0x55b928c65f60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c68a30 0x55b928c66f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 --2- 172.21.15.42:0/4164689488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c97900 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab3fe00640 0 client.5085 ms_handle_reset on v2:172.21.15.42:6834/3869657839 2024-08-17T02:28:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.966+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 >> 172.21.15.42:0/4164689488 conn(0x55b928bdc030 msgr2=0x55b928c3e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.967+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 shutdown_connections 2024-08-17T02:28:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.967+0000 7fab64625740 1 -- 172.21.15.42:0/4164689488 wait complete. 2024-08-17T02:28:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.967+0000 7fab64625740 20 client.5085 trim_cache size 0 max 16384 2024-08-17T02:28:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.983+0000 7fab64625740 1 Processor -- start 2024-08-17T02:28:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.983+0000 7fab64625740 1 -- start start 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.983+0000 7fab64625740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c66f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.983+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c68a30 0x55b928c67470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c86b10 0x55b928ca0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab64625740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b92891bf20 con 0x55b928c440a0 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928c976c0 con 0x55b928c68a30 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b928c66970 con 0x55b928c86b10 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c66f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c66f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39040/0 (socket says 172.21.15.42:39040) 2024-08-17T02:28:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 -- 172.21.15.42:0/334346034 learned_addr learned my addr 172.21.15.42:0/334346034 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 -- 172.21.15.42:0/334346034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c86b10 msgr2=0x55b928ca0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c86b10 0x55b928ca0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 -- 172.21.15.42:0/334346034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c68a30 msgr2=0x55b928c67470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c68a30 0x55b928c67470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 -- 172.21.15.42:0/334346034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b928b6e490 con 0x55b928c440a0 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.984+0000 7fab5b400640 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c66f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab4c007ac0 tx=0x7fab4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728d4afd6a54d59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab4be00640 1 -- 172.21.15.42:0/334346034 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c013b20 con 0x55b928c440a0 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab4be00640 1 -- 172.21.15.42:0/334346034 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c013c80 con 0x55b928c440a0 2024-08-17T02:28:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab4be00640 1 -- 172.21.15.42:0/334346034 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c013420 con 0x55b928c440a0 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 -- 172.21.15.42:0/334346034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 msgr2=0x55b928c66f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c66f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab4c007ac0 tx=0x7fab4c017000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 -- 172.21.15.42:0/334346034 shutdown_connections 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c86b10 0x55b928ca0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c68a30 0x55b928c67470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 --2- 172.21.15.42:0/334346034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c440a0 0x55b928c66f30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 -- 172.21.15.42:0/334346034 >> 172.21.15.42:0/334346034 conn(0x55b928bdc030 msgr2=0x55b928c963d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 -- 172.21.15.42:0/334346034 shutdown_connections 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.985+0000 7fab64625740 1 -- 172.21.15.42:0/334346034 wait complete. 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.986+0000 7fab64625740 1 -- start start 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.986+0000 7fab64625740 1 Processor -- start 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c440a0 0x55b928c6ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 0x55b928cee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c9e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928c6d5f0 con 0x55b928c68a30 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b928c9f490 con 0x55b928c86b10 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b928c978b0 con 0x55b928c440a0 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab64625740 10 client.0 _ll_register_callbacks cb 0x55b928c66550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 0x55b928cee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 0x55b928cee690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39042/0 (socket says 172.21.15.42:39042) 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.987+0000 7fab53e00640 1 -- 172.21.15.42:0/2028842993 learned_addr learned my addr 172.21.15.42:0/2028842993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab5b400640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c440a0 0x55b928c6ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab5be00640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c9e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab53e00640 1 -- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c440a0 msgr2=0x55b928c6ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab53e00640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c440a0 0x55b928c6ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab53e00640 1 -- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 msgr2=0x55b928c9e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab53e00640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c9e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab53e00640 1 -- 172.21.15.42:0/2028842993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b928b6aab0 con 0x55b928c68a30 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab53e00640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 0x55b928cee690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab44009850 tx=0x7fab44049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78fccede5727466 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab3fe00640 1 -- 172.21.15.42:0/2028842993 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab44032720 con 0x55b928c68a30 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab3fe00640 1 -- 172.21.15.42:0/2028842993 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab4404c070 con 0x55b928c68a30 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab440325b0 con 0x55b928c68a30 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab3fe00640 1 -- 172.21.15.42:0/2028842993 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab44032880 con 0x55b928c68a30 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab64625740 10 client.5091 fetch_fsmap learned FSMap version 15 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.988+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b928b6e1e0 con 0x55b928c68a30 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab3fe00640 1 -- 172.21.15.42:0/2028842993 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440325b0 con 0x55b928c68a30 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab3fe00640 1 -- 172.21.15.42:0/2028842993 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fab44005b80 con 0x55b928c68a30 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab64625740 10 client.5091 fetch_fsmap finished waiting for FSMap version 15 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab64625740 10 client.5091 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab64625740 20 client.5091 populate_metadata read hostname 'smithi042' 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab64625740 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c646a0 0x55b928c64a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab64625740 4 client.5091 mds_command: new command op to 4887 tid=0[{"prefix": "status"}] 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 --> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b9288b96c0 con 0x55b928c646a0 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.989+0000 7fab5b400640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c646a0 0x55b928c64a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab5b400640 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c646a0 0x55b928c64a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c62756176870450a server_cookie=b662398a7bd949ce in_seq=0 out_seq=0 2024-08-17T02:28:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab3fe00640 10 client.5091 ms_handle_connect on v2:172.21.15.42:6834/3869657839 2024-08-17T02:28:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab3fe00640 1 -- 172.21.15.42:0/2028842993 <== mds.0 v2:172.21.15.42:6834/3869657839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b9288b96c0 con 0x55b928c646a0 2024-08-17T02:28:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab3fe00640 10 client.5091 handle_command_reply: tid=0 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 client.5091 shutdown 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 msgr2=0x55b928cee690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 0x55b928cee690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab44009850 tx=0x7fab44049040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 shutdown_connections 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:6834/3869657839,v1:172.21.15.42:6836/3869657839] conn(0x55b928c646a0 0x55b928c64a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b928c86b10 0x55b928c9e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b928c68a30 0x55b928cee690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 --2- 172.21.15.42:0/2028842993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55b928c440a0 0x55b928c6ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab3fe00640 0 client.5091 ms_handle_reset on v2:172.21.15.42:6834/3869657839 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 >> 172.21.15.42:0/2028842993 conn(0x55b928bdc030 msgr2=0x55b928c69f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 shutdown_connections 2024-08-17T02:28:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.990+0000 7fab64625740 1 -- 172.21.15.42:0/2028842993 wait complete. 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab64625740 20 client.5091 trim_cache size 0 max 16384 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0", 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4887, 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.0898439299999998, 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 15, 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 32, 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 13.934069109999999 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab38065150 msgr2=0x7fab38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab38065150 0x7fab38067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab4c001800 tx=0x7fab4c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 msgr2=0x7fab5c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c1536f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab54009fa0 tx=0x7fab54009900 comp rx=0 tx=0).stop 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 shutdown_connections 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fab38065150 0x7fab38067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab5c0ca050 0x7fab5c1536f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab5c0add30 0x7fab5c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 --2- 172.21.15.42:0/3327073363 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fab5c0ad960 0x7fab5c14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 >> 172.21.15.42:0/3327073363 conn(0x7fab5c066e60 msgr2=0x7fab5c0b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 shutdown_connections 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:21.991+0000 7fab62000640 1 -- 172.21.15.42:0/3327073363 wait complete. 2024-08-17T02:28:22.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.156+0000 7f1dd7e00640 1 Processor -- start 2024-08-17T02:28:22.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.157+0000 7f1dd7e00640 1 -- start start 2024-08-17T02:28:22.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1dd8155010 0x7f1dd8069780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8159870 0x7f1dd8069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd7e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd81593e0 con 0x7f1dd80ad560 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd7e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd81563d0 con 0x7f1dd8155010 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8158d90 con 0x7f1dd8159870 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd6a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1dd8155010 0x7f1dd8069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd6a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1dd8155010 0x7f1dd8069780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39054/0 (socket says 172.21.15.42:39054) 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd6a00640 1 -- 172.21.15.42:0/2491653573 learned_addr learned my addr 172.21.15.42:0/2491653573 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:22.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.158+0000 7f1dd6000640 1 --2- 172.21.15.42:0/2491653573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8159870 0x7f1dd8069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.159+0000 7f1dd6a00640 1 -- 172.21.15.42:0/2491653573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8159870 msgr2=0x7f1dd8069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.159+0000 7f1dd6a00640 1 --2- 172.21.15.42:0/2491653573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8159870 0x7f1dd8069cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.159+0000 7f1dd6a00640 1 -- 172.21.15.42:0/2491653573 >> v1:172.21.15.62:6789/0 conn(0x7f1dd80ad560 legacy=0x7f1dd81553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.159+0000 7f1dd6a00640 1 -- 172.21.15.42:0/2491653573 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8159070 con 0x7f1dd8155010 2024-08-17T02:28:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.159+0000 7f1dd5600640 1 -- 172.21.15.42:0/2491653573 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941877364 0 0) 0x7f1dd81593e0 con 0x7f1dd80ad560 2024-08-17T02:28:22.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.160+0000 7f1dd6a00640 1 --2- 172.21.15.42:0/2491653573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8155010 0x7f1dd8069780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009910 tx=0x7f1dc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96d083cc4bf188f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.160+0000 7f1dd5600640 1 -- 172.21.15.42:0/2491653573 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc802adb0 con 0x7f1dd8155010 2024-08-17T02:28:22.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.160+0000 7f1dd5600640 1 -- 172.21.15.42:0/2491653573 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8032440 con 0x7f1dd8155010 2024-08-17T02:28:22.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.160+0000 7f1dd5600640 1 -- 172.21.15.42:0/2491653573 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80327e0 con 0x7f1dd8155010 2024-08-17T02:28:22.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.160+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2491653573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8155010 msgr2=0x7f1dd8069780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2491653573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8155010 0x7f1dd8069780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009910 tx=0x7f1dc80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2491653573 shutdown_connections 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2491653573 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8159870 0x7f1dd8069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2491653573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8155010 0x7f1dd8069780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2491653573 >> 172.21.15.42:0/2491653573 conn(0x7f1dd8062af0 msgr2=0x7f1dd8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2491653573 shutdown_connections 2024-08-17T02:28:22.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.161+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2491653573 wait complete. 2024-08-17T02:28:22.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.162+0000 7f1dd7e00640 1 Processor -- start 2024-08-17T02:28:22.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.162+0000 7f1dd7e00640 1 -- start start 2024-08-17T02:28:22.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd80ad560 0x7f1dd8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 0x7f1dd8150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8159870 0x7f1dd80afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd81466f0 con 0x7f1dd8159870 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd81470c0 con 0x7f1dd80ad560 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8145ae0 con 0x7f1dd8155010 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd6000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 0x7f1dd8150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8159870 0x7f1dd80afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd6a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd80ad560 0x7f1dd8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd6000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 0x7f1dd8150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:54932/0 (socket says 172.21.15.42:54932) 2024-08-17T02:28:22.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.163+0000 7f1dd6000640 1 -- 172.21.15.42:0/2471957514 learned_addr learned my addr 172.21.15.42:0/2471957514 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6000640 1 -- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd80ad560 msgr2=0x7f1dd8146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6000640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd80ad560 0x7f1dd8146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6000640 1 -- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8159870 msgr2=0x7f1dd80afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6000640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8159870 0x7f1dd80afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6000640 1 -- 172.21.15.42:0/2471957514 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8009450 con 0x7f1dd8155010 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6a00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd80ad560 0x7f1dd8146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dd6000640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 0x7f1dd8150f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400ea20 tx=0x7f1dc40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.164+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400ca10 con 0x7f1dd8155010 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.165+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc400cb70 con 0x7f1dd8155010 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.165+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4013470 con 0x7f1dd8155010 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.165+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd8145dc0 con 0x7f1dd8155010 2024-08-17T02:28:22.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.165+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd8146380 con 0x7f1dd8155010 2024-08-17T02:28:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.166+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd81468a0 con 0x7f1dd8155010 2024-08-17T02:28:22.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.167+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1dc4013860 con 0x7f1dd8155010 2024-08-17T02:28:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.167+0000 7f1dce000640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1db8065150 0x7f1db8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.167+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1dc4082770 con 0x7f1dd8155010 2024-08-17T02:28:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.168+0000 7f1dd6a00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1db8065150 0x7f1db8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.168+0000 7f1dd6a00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1db8065150 0x7f1db8067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8034000 tx=0x7f1dc8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.172+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1dd81468a0 con 0x7f1dd8155010 2024-08-17T02:28:22.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.391+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1dd8146860 con 0x7f1dd8155010 2024-08-17T02:28:22.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.391+0000 7f1dce000640 1 -- 172.21.15.42:0/2471957514 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1dc4050840 con 0x7f1dd8155010 2024-08-17T02:28:22.392 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:22.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.393+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1db8065150 msgr2=0x7f1db8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.393+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1db8065150 0x7f1db8067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8034000 tx=0x7f1dc8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.393+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 msgr2=0x7f1dd8150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.393+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 0x7f1dd8150f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400ea20 tx=0x7f1dc40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 shutdown_connections 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1db8065150 0x7f1db8067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dd8159870 0x7f1dd80afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1dd8155010 0x7f1dd8150f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 --2- 172.21.15.42:0/2471957514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dd80ad560 0x7f1dd8146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 >> 172.21.15.42:0/2471957514 conn(0x7f1dd8062af0 msgr2=0x7f1dd806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 shutdown_connections 2024-08-17T02:28:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:22.394+0000 7f1dd7e00640 1 -- 172.21.15.42:0/2471957514 wait complete. 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:22.409 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:22.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:22.410 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-08-17T02:28:22.445 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:22.445 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:22.445 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:22.445 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-08-17T02:28:22.446 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 7e:25:12:09:13:29 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:22.447 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::4060:65ff:fea9:4731/64 scope link 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 7e:25:12:09:13:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::7c25:12ff:fe09:1329/64 scope link 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 82:54:a9:22:6b:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::8054:a9ff:fe22:6b73/64 scope link 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:22.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:22.449 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:22.540 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-08-17T02:28:22.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:22.543 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-08-17T02:28:22.579 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-08-17T02:28:22.579 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:22.579 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:22.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:22.580 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-08-17T02:28:22.580 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-08-17T02:28:22.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:28:22.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:28:22.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:28:22.580 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-08-17T02:28:22.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:22.726 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:28:22.761 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:22.761 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:28:22.761 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:22.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:22.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-08-17T02:28:22.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:22.858 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:22.893 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:22.893 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:22.968 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:28:22.968 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:22.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:23.090 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:23.091 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:23.116 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 0@f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0.cephfs=/ 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.42:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:23.121 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:23.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.121 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:23.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.328+0000 7fc663200640 1 Processor -- start 2024-08-17T02:28:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.329+0000 7fc663200640 1 -- start start 2024-08-17T02:28:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc663200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc664156f90 0x7fc6640b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc663200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66406d7c0 con 0x7fc6640b0e30 2024-08-17T02:28:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc663200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66415ab30 con 0x7fc66415a590 2024-08-17T02:28:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc663200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66415ae10 con 0x7fc664156f90 2024-08-17T02:28:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc661e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc6640b0e30 0x7fc6640cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49062/0 (socket says 172.21.15.42:49062) 2024-08-17T02:28:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc661e00640 1 -- 172.21.15.42:0/1150991507 learned_addr learned my addr 172.21.15.42:0/1150991507 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.330+0000 7fc65be00640 1 --2- 172.21.15.42:0/1150991507 >> v2:172.21.15.62:3300/0 conn(0x7fc664156f90 0x7fc6640b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477541421 0 0) 0x7fc66406d7c0 con 0x7fc6640b0e30 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6480034e0 con 0x7fc6640b0e30 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3549342524 0 0) 0x7fc6480034e0 con 0x7fc6640b0e30 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 >> v2:172.21.15.62:3300/0 conn(0x7fc664156f90 msgr2=0x7fc6640b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 --2- 172.21.15.42:0/1150991507 >> v2:172.21.15.62:3300/0 conn(0x7fc664156f90 0x7fc6640b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 >> v1:172.21.15.62:6789/0 conn(0x7fc66415a590 legacy=0x7fc66413fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66415b0f0 con 0x7fc6640b0e30 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fc654001470 con 0x7fc6640b0e30 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 >> v1:172.21.15.42:6789/0 conn(0x7fc6640b0e30 legacy=0x7fc6640cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc648003a40 0x7fc648003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc648004780 0x7fc648004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648005130 0x7fc64800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415ae10 con 0x7fc648004780 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64800c020 con 0x7fc648003a40 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64800c1e0 con 0x7fc648005130 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc65be00640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc648004780 0x7fc648004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc661e00640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc648003a40 0x7fc648003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.331+0000 7fc662800640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648005130 0x7fc64800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.332+0000 7fc65be00640 1 -- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648005130 msgr2=0x7fc64800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.332+0000 7fc65be00640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648005130 0x7fc64800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.332+0000 7fc65be00640 1 -- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc648003a40 msgr2=0x7fc648003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.332+0000 7fc65be00640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc648003a40 0x7fc648003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.332+0000 7fc65be00640 1 -- 172.21.15.42:0/1150991507 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480034e0 con 0x7fc648004780 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.332+0000 7fc662800640 1 -- 172.21.15.42:0/1150991507 reap_dead start 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.333+0000 7fc65be00640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc648004780 0x7fc648004bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009b70 tx=0x7fc64c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b350cfa42fbb689 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.333+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031400 con 0x7fc648004780 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.333+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c02d050 con 0x7fc648004780 2024-08-17T02:28:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.333+0000 7fc661400640 1 -- 172.21.15.42:0/1150991507 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031790 con 0x7fc648004780 2024-08-17T02:28:23.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.333+0000 7fc663200640 1 -- 172.21.15.42:0/1150991507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc648004780 msgr2=0x7fc648004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.333+0000 7fc663200640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc648004780 0x7fc648004bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009b70 tx=0x7fc64c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.334+0000 7fc663200640 1 -- 172.21.15.42:0/1150991507 shutdown_connections 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.334+0000 7fc663200640 1 --2- 172.21.15.42:0/1150991507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc648004780 0x7fc648004bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.334+0000 7fc663200640 1 -- 172.21.15.42:0/1150991507 >> 172.21.15.42:0/1150991507 conn(0x7fc664062af0 msgr2=0x7fc664062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.334+0000 7fc663200640 1 -- 172.21.15.42:0/1150991507 shutdown_connections 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.334+0000 7fc663200640 1 -- 172.21.15.42:0/1150991507 wait complete. 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.335+0000 7fc663200640 1 Processor -- start 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.335+0000 7fc663200640 1 -- start start 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc663200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648004780 0x7fc664159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc663200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 0x7fc66415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc663200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc66415bc00 0x7fc66415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc663200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664158080 con 0x7fc66415a010 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc663200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415c590 con 0x7fc66415bc00 2024-08-17T02:28:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc663200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc664157400 con 0x7fc648004780 2024-08-17T02:28:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc65be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 0x7fc66415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc65be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 0x7fc66415b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39074/0 (socket says 172.21.15.42:39074) 2024-08-17T02:28:23.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.336+0000 7fc65be00640 1 -- 172.21.15.42:0/4106004481 learned_addr learned my addr 172.21.15.42:0/4106004481 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc661e00640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648004780 0x7fc664159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc662800640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc66415bc00 0x7fc66415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc65be00640 1 -- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648004780 msgr2=0x7fc664159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc65be00640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648004780 0x7fc664159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc65be00640 1 -- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc66415bc00 msgr2=0x7fc66415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc65be00640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc66415bc00 0x7fc66415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc65be00640 1 -- 172.21.15.42:0/4106004481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6641576e0 con 0x7fc66415a010 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc662800640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc66415bc00 0x7fc66415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc65be00640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 0x7fc66415b6c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc64c02aae0 tx=0x7fc64c035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.337+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c000c40 con 0x7fc66415a010 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.338+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c030a60 con 0x7fc66415a010 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.338+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c030e20 con 0x7fc66415a010 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.338+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6641579c0 con 0x7fc66415a010 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.338+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6640c7c90 con 0x7fc66415a010 2024-08-17T02:28:23.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.339+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6641581c0 con 0x7fc66415a010 2024-08-17T02:28:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.339+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc64c045620 con 0x7fc66415a010 2024-08-17T02:28:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.340+0000 7fc659600640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc640065150 0x7fc640067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.340+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc64c0a3590 con 0x7fc66415a010 2024-08-17T02:28:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.341+0000 7fc661e00640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc640065150 0x7fc640067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.341+0000 7fc661e00640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc640065150 0x7fc640067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc654007ea0 tx=0x7fc654001df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.345+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6641581c0 con 0x7fc66415a010 2024-08-17T02:28:23.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.565+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc664070720 con 0x7fc66415a010 2024-08-17T02:28:23.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.565+0000 7fc659600640 1 -- 172.21.15.42:0/4106004481 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc64c0750f0 con 0x7fc66415a010 2024-08-17T02:28:23.566 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc640065150 msgr2=0x7fc640067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc640065150 0x7fc640067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc654007ea0 tx=0x7fc654001df0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 msgr2=0x7fc66415b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 0x7fc66415b6c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc64c02aae0 tx=0x7fc64c035000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 shutdown_connections 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc640065150 0x7fc640067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc66415bc00 0x7fc66415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc66415a010 0x7fc66415b6c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 --2- 172.21.15.42:0/4106004481 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc648004780 0x7fc664159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.567+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 >> 172.21.15.42:0/4106004481 conn(0x7fc664062af0 msgr2=0x7fc66413cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.568+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 shutdown_connections 2024-08-17T02:28:23.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:23.568+0000 7fc663200640 1 -- 172.21.15.42:0/4106004481 wait complete. 2024-08-17T02:28:23.582 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:23.583 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:23.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.583 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-08-17T02:28:23.625 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:23.626 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42600sec preferred_lft 42600sec 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 62:c5:68:c8:4a:59 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:23.627 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::94f1:cdff:fee8:fb85/64 scope link 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 62:c5:68:c8:4a:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::60c5:68ff:fec8:4a59/64 scope link 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 9a:03:0b:6f:4c:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::9803:bff:fe6f:4caf/64 scope link 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:23.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.628 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:23.725 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-08-17T02:28:23.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.729 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-08-17T02:28:23.765 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-08-17T02:28:23.766 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:23.766 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:23.766 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:23.766 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:23.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.766 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2024-08-17T02:28:23.766 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-08-17T02:28:23.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:23.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:23.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:23.767 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-08-17T02:28:23.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.914 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:28:23.949 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:23.949 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:28:23.949 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:23.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:23.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-08-17T02:28:24.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:24.046 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:24.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:24.081 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:24.155 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:28:24.156 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:24.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:24.277 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:24.304 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:24.304 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:24.304 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-08-17T02:28:24.304 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with new device syntax: 1@f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0.cephfs=/ 2024-08-17T02:28:24.304 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.42:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-08-17T02:28:24.305 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:28:24.305 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:24.305 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:24.305 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:24.305 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:24.308 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:24.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:24.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:24.364 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:28:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.527+0000 7f193aa00640 1 Processor -- start 2024-08-17T02:28:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.528+0000 7f193aa00640 1 -- start start 2024-08-17T02:28:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340af460 0x7f19340af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193aa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f19340afde0 0x7f19340a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193aa00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f19340cb680 0x7f1934159b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193aa00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340ad560 con 0x7f19340cb680 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193aa00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340ad820 con 0x7f19340afde0 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193aa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19340adb00 con 0x7f19340af460 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f19340cb680 0x7f1934159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f19340cb680 0x7f1934159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39082/0 (socket says 172.21.15.42:39082) 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 -- 172.21.15.42:0/342412259 learned_addr learned my addr 172.21.15.42:0/342412259 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f1938c00640 1 --2- 172.21.15.42:0/342412259 >> v2:172.21.15.62:3300/0 conn(0x7f19340afde0 0x7f19340a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f1939600640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340af460 0x7f19340af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 -- 172.21.15.42:0/342412259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340af460 msgr2=0x7f19340af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340af460 0x7f19340af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 -- 172.21.15.42:0/342412259 >> v2:172.21.15.62:3300/0 conn(0x7f19340afde0 msgr2=0x7f19340a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 --2- 172.21.15.42:0/342412259 >> v2:172.21.15.62:3300/0 conn(0x7f19340afde0 0x7f19340a7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f193a000640 1 -- 172.21.15.42:0/342412259 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340adde0 con 0x7f19340cb680 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f1939600640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340af460 0x7f19340af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.529+0000 7f1938c00640 1 --2- 172.21.15.42:0/342412259 >> v2:172.21.15.62:3300/0 conn(0x7f19340afde0 0x7f19340a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.530+0000 7f193a000640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340cb680 0x7f1934159b70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f193406f0e0 tx=0x7f192c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0aa59a97d4fee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f1933e00640 1 -- 172.21.15.42:0/342412259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c031400 con 0x7f19340cb680 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f1933e00640 1 -- 172.21.15.42:0/342412259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c02d050 con 0x7f19340cb680 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f1933e00640 1 -- 172.21.15.42:0/342412259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0317d0 con 0x7f19340cb680 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 -- 172.21.15.42:0/342412259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340cb680 msgr2=0x7f1934159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340cb680 0x7f1934159b70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f193406f0e0 tx=0x7f192c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 -- 172.21.15.42:0/342412259 shutdown_connections 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340cb680 0x7f1934159b70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 --2- 172.21.15.42:0/342412259 >> v2:172.21.15.62:3300/0 conn(0x7f19340afde0 0x7f19340a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 --2- 172.21.15.42:0/342412259 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340af460 0x7f19340af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 -- 172.21.15.42:0/342412259 >> 172.21.15.42:0/342412259 conn(0x7f1934066e60 msgr2=0x7f1934067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 -- 172.21.15.42:0/342412259 shutdown_connections 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.531+0000 7f193aa00640 1 -- 172.21.15.42:0/342412259 wait complete. 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.533+0000 7f193aa00640 1 Processor -- start 2024-08-17T02:28:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.533+0000 7f193aa00640 1 -- start start 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f193aa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19340af460 0x7f1934069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f193aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 0x7f1934155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f193aa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340cb680 0x7f1934095d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f193aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193416c2e0 con 0x7f19340afde0 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f193aa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934169200 con 0x7f19340af460 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f193aa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19341694e0 con 0x7f19340cb680 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f1938c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 0x7f1934155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f1938c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 0x7f1934155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39096/0 (socket says 172.21.15.42:39096) 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f1938c00640 1 -- 172.21.15.42:0/1041049106 learned_addr learned my addr 172.21.15.42:0/1041049106 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.534+0000 7f1939600640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19340af460 0x7f1934069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f193a000640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340cb680 0x7f1934095d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1938c00640 1 -- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340cb680 msgr2=0x7f1934095d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1938c00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340cb680 0x7f1934095d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1938c00640 1 -- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19340af460 msgr2=0x7f1934069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1938c00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19340af460 0x7f1934069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1938c00640 1 -- 172.21.15.42:0/1041049106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009ae0 con 0x7f19340afde0 2024-08-17T02:28:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1938c00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 0x7f1934155a20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f192000d890 tx=0x7f1920008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.535+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192000de80 con 0x7f19340afde0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.536+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19200098d0 con 0x7f19340afde0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.536+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920009c90 con 0x7f19340afde0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.536+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19341697c0 con 0x7f19340afde0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.536+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934069e40 con 0x7f19340afde0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.537+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19340cd6e0 con 0x7f19340afde0 2024-08-17T02:28:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.537+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1920014410 con 0x7f19340afde0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.538+0000 7f1930c00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1914065150 0x7f1914067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.538+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1920082c60 con 0x7f19340afde0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.538+0000 7f1939600640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1914065150 0x7f1914067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.539+0000 7f1939600640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1914065150 0x7f1914067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1928006e70 tx=0x7f1928008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.542+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f19340cd6e0 con 0x7f19340afde0 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.766+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19340cd6e0 con 0x7f19340afde0 2024-08-17T02:28:24.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.979+0000 7f1930c00640 1 -- 172.21.15.42:0/1041049106 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 136+0+0 (secure 0 0 0) 0x7f19340cd6e0 con 0x7f19340afde0 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1914065150 msgr2=0x7f1914067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1914065150 0x7f1914067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1928006e70 tx=0x7f1928008040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 msgr2=0x7f1934155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 0x7f1934155a20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f192000d890 tx=0x7f1920008040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 shutdown_connections 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1914065150 0x7f1914067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f19340cb680 0x7f1934095d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19340afde0 0x7f1934155a20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 --2- 172.21.15.42:0/1041049106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19340af460 0x7f1934069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.981+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 >> 172.21.15.42:0/1041049106 conn(0x7f1934066e60 msgr2=0x7f19340ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.982+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 shutdown_connections 2024-08-17T02:28:24.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:24.982+0000 7f193aa00640 1 -- 172.21.15.42:0/1041049106 wait complete. 2024-08-17T02:28:24.998 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:25.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.149+0000 7f5ed5000640 1 Processor -- start 2024-08-17T02:28:25.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.150+0000 7f5ed5000640 1 -- start start 2024-08-17T02:28:25.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ed5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed00afca0 0x7f5ed00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ed5000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5ed00acf10 0x7f5ed0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ed5000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed015a4e0 con 0x7f5ed01589a0 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ed5000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed00b0980 con 0x7f5ed00acf10 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ed5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c92b0 con 0x7f5ed00afca0 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ece800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5ed01589a0 0x7f5ed006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49072/0 (socket says 172.21.15.42:49072) 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ece800640 1 -- 172.21.15.42:0/2180608479 learned_addr learned my addr 172.21.15.42:0/2180608479 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ecde00640 1 --2- 172.21.15.42:0/2180608479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed00afca0 0x7f5ed00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.151+0000 7f5ec7e00640 1 --2- 172.21.15.42:0/2180608479 >> v2:172.21.15.62:3300/0 conn(0x7f5ed00acf10 0x7f5ed0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ecd400640 1 -- 172.21.15.42:0/2180608479 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025871472 0 0) 0x7f5ec8001490 con 0x7f5ed01589a0 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ecd400640 1 -- 172.21.15.42:0/2180608479 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb40034e0 con 0x7f5ed01589a0 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ecde00640 1 -- 172.21.15.42:0/2180608479 >> v2:172.21.15.62:3300/0 conn(0x7f5ed00acf10 msgr2=0x7f5ed0159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ecde00640 1 --2- 172.21.15.42:0/2180608479 >> v2:172.21.15.62:3300/0 conn(0x7f5ed00acf10 0x7f5ed0159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ecde00640 1 -- 172.21.15.42:0/2180608479 >> v1:172.21.15.42:6789/0 conn(0x7f5ed01589a0 legacy=0x7f5ed006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ecde00640 1 -- 172.21.15.42:0/2180608479 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed00ad480 con 0x7f5ed00afca0 2024-08-17T02:28:25.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.152+0000 7f5ec7e00640 1 --2- 172.21.15.42:0/2180608479 >> v2:172.21.15.62:3300/0 conn(0x7f5ed00acf10 0x7f5ed0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:25.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.153+0000 7f5ecde00640 1 --2- 172.21.15.42:0/2180608479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed00afca0 0x7f5ed00b0070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009880 tx=0x7f5ec00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46ac1f1481d6a90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ecd400640 1 -- 172.21.15.42:0/2180608479 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec002ad90 con 0x7f5ed00afca0 2024-08-17T02:28:25.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ecd400640 1 -- 172.21.15.42:0/2180608479 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0032440 con 0x7f5ed00afca0 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ecd400640 1 -- 172.21.15.42:0/2180608479 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0032820 con 0x7f5ed00afca0 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 -- 172.21.15.42:0/2180608479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed00afca0 msgr2=0x7f5ed00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 --2- 172.21.15.42:0/2180608479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed00afca0 0x7f5ed00b0070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009880 tx=0x7f5ec00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 -- 172.21.15.42:0/2180608479 shutdown_connections 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 --2- 172.21.15.42:0/2180608479 >> v2:172.21.15.62:3300/0 conn(0x7f5ed00acf10 0x7f5ed0159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 --2- 172.21.15.42:0/2180608479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed00afca0 0x7f5ed00b0070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 -- 172.21.15.42:0/2180608479 >> 172.21.15.42:0/2180608479 conn(0x7f5ed0066e60 msgr2=0x7f5ed0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 -- 172.21.15.42:0/2180608479 shutdown_connections 2024-08-17T02:28:25.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.154+0000 7f5ed5000640 1 -- 172.21.15.42:0/2180608479 wait complete. 2024-08-17T02:28:25.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.156+0000 7f5ed5000640 1 Processor -- start 2024-08-17T02:28:25.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.156+0000 7f5ed5000640 1 -- start start 2024-08-17T02:28:25.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ed5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 0x7f5ed0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ed5000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed00afca0 0x7f5ed01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ed5000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed01589a0 0x7f5ed0147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ed5000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0156580 con 0x7f5ed00acf10 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ed5000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0156f50 con 0x7f5ed00afca0 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ed5000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0155970 con 0x7f5ed01589a0 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ecde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 0x7f5ed0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ecde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 0x7f5ed0156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39104/0 (socket says 172.21.15.42:39104) 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ecde00640 1 -- 172.21.15.42:0/3817242041 learned_addr learned my addr 172.21.15.42:0/3817242041 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ece800640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed01589a0 0x7f5ed0147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.157+0000 7f5ec7e00640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed00afca0 0x7f5ed01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ecde00640 1 -- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed01589a0 msgr2=0x7f5ed0147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ecde00640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed01589a0 0x7f5ed0147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ecde00640 1 -- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed00afca0 msgr2=0x7f5ed01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ecde00640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed00afca0 0x7f5ed01550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ecde00640 1 -- 172.21.15.42:0/3817242041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8009390 con 0x7f5ed00acf10 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ece800640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed01589a0 0x7f5ed0147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ecde00640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 0x7f5ed0156a10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009880 tx=0x7f5ec0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0031c20 con 0x7f5ed00acf10 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0031d80 con 0x7f5ed00acf10 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec003d670 con 0x7f5ed00acf10 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec0009390 con 0x7f5ed00acf10 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.158+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed0155f30 con 0x7f5ed00acf10 2024-08-17T02:28:25.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.159+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed0068180 con 0x7f5ed00acf10 2024-08-17T02:28:25.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.160+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ec0039040 con 0x7f5ed00acf10 2024-08-17T02:28:25.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.161+0000 7f5ec5600640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5eac065150 0x7f5eac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.161+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ec00a23b0 con 0x7f5ed00acf10 2024-08-17T02:28:25.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.161+0000 7f5ec7e00640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5eac065150 0x7f5eac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.162+0000 7f5ec7e00640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5eac065150 0x7f5eac067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009360 tx=0x7f5eb8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.165+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ec00703d0 con 0x7f5ed00acf10 2024-08-17T02:28:25.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.374+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ed0067b70 con 0x7f5eac065150 2024-08-17T02:28:25.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.375+0000 7f5ec5600640 1 -- 172.21.15.42:0/3817242041 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5ed0067b70 con 0x7f5eac065150 2024-08-17T02:28:25.375 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-08-17T02:28:25.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:25.376 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephfs" 2024-08-17T02:28:25.376 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:25.376 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-08-17T02:28:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5eac065150 msgr2=0x7f5eac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5eac065150 0x7f5eac067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009360 tx=0x7f5eb8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 msgr2=0x7f5ed0156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 0x7f5ed0156a10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009880 tx=0x7f5ec0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 shutdown_connections 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5eac065150 0x7f5eac067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ed01589a0 0x7f5ed0147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ed00afca0 0x7f5ed01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 --2- 172.21.15.42:0/3817242041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ed00acf10 0x7f5ed0156a10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 >> 172.21.15.42:0/3817242041 conn(0x7f5ed0066e60 msgr2=0x7f5ed00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 shutdown_connections 2024-08-17T02:28:25.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.378+0000 7f5ed5000640 1 -- 172.21.15.42:0/3817242041 wait complete. 2024-08-17T02:28:25.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:28:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.548+0000 7fc050a00640 1 Processor -- start 2024-08-17T02:28:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.549+0000 7fc050a00640 1 -- start start 2024-08-17T02:28:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc050a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc04c158a40 0x7fc04c0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc050a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c0686f0 con 0x7fc04c0ac380 2024-08-17T02:28:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc050a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c0b0270 con 0x7fc04c0af9b0 2024-08-17T02:28:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc050a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0ac800 con 0x7fc04c158a40 2024-08-17T02:28:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc043e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc04c0ac380 0x7fc04c0af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49088/0 (socket says 172.21.15.42:49088) 2024-08-17T02:28:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc043e00640 1 -- 172.21.15.42:0/4126086548 learned_addr learned my addr 172.21.15.42:0/4126086548 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.550+0000 7fc04a800640 1 --2- 172.21.15.42:0/4126086548 >> v2:172.21.15.62:3300/0 conn(0x7fc04c158a40 0x7fc04c0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1691487501 0 0) 0x7fc04c0686f0 con 0x7fc04c0ac380 2024-08-17T02:28:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0300034e0 con 0x7fc04c0ac380 2024-08-17T02:28:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175339879 0 0) 0x7fc04c0b0270 con 0x7fc04c0af9b0 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c0686f0 con 0x7fc04c0af9b0 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338488229 0 0) 0x7fc0300034e0 con 0x7fc04c0ac380 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc04a800640 1 -- 172.21.15.42:0/4126086548 >> v1:172.21.15.62:6789/0 conn(0x7fc04c0af9b0 legacy=0x7fc04c068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc04a800640 1 -- 172.21.15.42:0/4126086548 >> v1:172.21.15.42:6789/0 conn(0x7fc04c0ac380 legacy=0x7fc04c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.551+0000 7fc04a800640 1 -- 172.21.15.42:0/4126086548 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c0aff90 con 0x7fc04c158a40 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.552+0000 7fc04a800640 1 --2- 172.21.15.42:0/4126086548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c158a40 0x7fc04c0abe40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009850 tx=0x7fc03c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11517b7ab3bdb453 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.552+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034001470 con 0x7fc04c158a40 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.552+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c02a9c0 con 0x7fc04c158a40 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.552+0000 7fc049e00640 1 -- 172.21.15.42:0/4126086548 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c02ad60 con 0x7fc04c158a40 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 -- 172.21.15.42:0/4126086548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c158a40 msgr2=0x7fc04c0abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 --2- 172.21.15.42:0/4126086548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c158a40 0x7fc04c0abe40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009850 tx=0x7fc03c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 -- 172.21.15.42:0/4126086548 shutdown_connections 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 --2- 172.21.15.42:0/4126086548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c158a40 0x7fc04c0abe40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 -- 172.21.15.42:0/4126086548 >> 172.21.15.42:0/4126086548 conn(0x7fc04c0ce400 msgr2=0x7fc04c095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 -- 172.21.15.42:0/4126086548 shutdown_connections 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.553+0000 7fc050a00640 1 -- 172.21.15.42:0/4126086548 wait complete. 2024-08-17T02:28:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.554+0000 7fc050a00640 1 Processor -- start 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.555+0000 7fc050a00640 1 -- start start 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.555+0000 7fc050a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc04c0ac380 0x7fc04c15e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.555+0000 7fc050a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c0af9b0 0x7fc04c098f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.555+0000 7fc050a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 0x7fc04c158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc050a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c099440 con 0x7fc04c158a40 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc050a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c156d00 con 0x7fc04c0af9b0 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc050a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c099670 con 0x7fc04c0ac380 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 0x7fc04c158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 0x7fc04c158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39118/0 (socket says 172.21.15.42:39118) 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 -- 172.21.15.42:0/2088428923 learned_addr learned my addr 172.21.15.42:0/2088428923 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 -- 172.21.15.42:0/2088428923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc04c0ac380 msgr2=0x7fc04c15e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc04c0ac380 0x7fc04c15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 -- 172.21.15.42:0/2088428923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c0af9b0 msgr2=0x7fc04c098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c0af9b0 0x7fc04c098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 -- 172.21.15.42:0/2088428923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c009390 con 0x7fc04c158a40 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.556+0000 7fc04b200640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 0x7fc04c158e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c910 tx=0x7fc0440026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.557+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400cea0 con 0x7fc04c158a40 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.557+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04400a850 con 0x7fc04c158a40 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.557+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400ac70 con 0x7fc04c158a40 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.557+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c0999b0 con 0x7fc04c158a40 2024-08-17T02:28:25.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.557+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c09a1f0 con 0x7fc04c158a40 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.558+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c09a410 con 0x7fc04c158a40 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.559+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc044012630 con 0x7fc04c158a40 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.560+0000 7fc042000640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc028065150 0x7fc028067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.560+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0440827f0 con 0x7fc04c158a40 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.560+0000 7fc04a800640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc028065150 0x7fc028067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.561+0000 7fc04a800640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc028065150 0x7fc028067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc03c034000 tx=0x7fc03c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.564+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc044050810 con 0x7fc04c158a40 2024-08-17T02:28:25.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.747+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc04c070720 con 0x7fc04c158a40 2024-08-17T02:28:25.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.748+0000 7fc042000640 1 -- 172.21.15.42:0/2088428923 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc044053e30 con 0x7fc04c158a40 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc028065150 msgr2=0x7fc028067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc028065150 0x7fc028067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc03c034000 tx=0x7fc03c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 msgr2=0x7fc04c158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 0x7fc04c158e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c910 tx=0x7fc0440026f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 shutdown_connections 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc028065150 0x7fc028067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc04c158a40 0x7fc04c158e10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc04c0af9b0 0x7fc04c098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 --2- 172.21.15.42:0/2088428923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc04c0ac380 0x7fc04c15e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 >> 172.21.15.42:0/2088428923 conn(0x7fc04c0ce400 msgr2=0x7fc04c095bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 shutdown_connections 2024-08-17T02:28:25.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.750+0000 7fc050a00640 1 -- 172.21.15.42:0/2088428923 wait complete. 2024-08-17T02:28:25.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000001039443 2024-08-17T02:28:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.919+0000 7fb4f7c00640 1 Processor -- start 2024-08-17T02:28:25.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.919+0000 7fb4f7c00640 1 -- start start 2024-08-17T02:28:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4f7c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00acf10 0x7fb4f00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4f7c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00c92b0 con 0x7fb4f01590b0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4f7c00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00ad480 con 0x7fb4f00afca0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4f7c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00b0980 con 0x7fb4f00acf10 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4efe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb4f01590b0 0x7fb4f00c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49100/0 (socket says 172.21.15.42:49100) 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4efe00640 1 -- 172.21.15.42:0/1612669633 learned_addr learned my addr 172.21.15.42:0/1612669633 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4f5c00640 1 --2- 172.21.15.42:0/1612669633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00acf10 0x7fb4f00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253490175 0 0) 0x7fb4f00c92b0 con 0x7fb4f01590b0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d80034e0 con 0x7fb4f01590b0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507587434 0 0) 0x7fb4f00ad480 con 0x7fb4f00afca0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f00c92b0 con 0x7fb4f00afca0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.921+0000 7fb4f5c00640 1 -- 172.21.15.42:0/1612669633 >> v1:172.21.15.62:6789/0 conn(0x7fb4f00afca0 legacy=0x7fb4f01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.922+0000 7fb4f5c00640 1 -- 172.21.15.42:0/1612669633 >> v1:172.21.15.42:6789/0 conn(0x7fb4f01590b0 legacy=0x7fb4f00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.922+0000 7fb4f5c00640 1 -- 172.21.15.42:0/1612669633 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00ad760 con 0x7fb4f00acf10 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.923+0000 7fb4f5c00640 1 --2- 172.21.15.42:0/1612669633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00acf10 0x7fb4f00b0070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009e90 tx=0x7fb4e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5035a560a3238844 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.923+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8007550 con 0x7fb4f00acf10 2024-08-17T02:28:25.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.923+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e802d050 con 0x7fb4f00acf10 2024-08-17T02:28:25.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.923+0000 7fb4ef400640 1 -- 172.21.15.42:0/1612669633 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80078e0 con 0x7fb4f00acf10 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.923+0000 7fb4f7c00640 1 -- 172.21.15.42:0/1612669633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00acf10 msgr2=0x7fb4f00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.923+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/1612669633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00acf10 0x7fb4f00b0070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009e90 tx=0x7fb4e8009780 comp rx=0 tx=0).stop 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.924+0000 7fb4f7c00640 1 -- 172.21.15.42:0/1612669633 shutdown_connections 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.924+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/1612669633 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00acf10 0x7fb4f00b0070 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.924+0000 7fb4f7c00640 1 -- 172.21.15.42:0/1612669633 >> 172.21.15.42:0/1612669633 conn(0x7fb4f0066e60 msgr2=0x7fb4f0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.924+0000 7fb4f7c00640 1 -- 172.21.15.42:0/1612669633 shutdown_connections 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.924+0000 7fb4f7c00640 1 -- 172.21.15.42:0/1612669633 wait complete. 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.925+0000 7fb4f7c00640 1 Processor -- start 2024-08-17T02:28:25.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.925+0000 7fb4f7c00640 1 -- start start 2024-08-17T02:28:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f7c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 0x7fb4f016a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f7c00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00afca0 0x7fb4f016bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f7c00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f01590b0 0x7fb4f01690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f7c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c5100 con 0x7fb4f00acf10 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f7c00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0169b90 con 0x7fb4f01590b0 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f7c00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0169e70 con 0x7fb4f00afca0 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 0x7fb4f016a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 0x7fb4f016a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39120/0 (socket says 172.21.15.42:39120) 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.926+0000 7fb4f5200640 1 -- 172.21.15.42:0/2321553891 learned_addr learned my addr 172.21.15.42:0/2321553891 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4efe00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00afca0 0x7fb4f016bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f01590b0 0x7fb4f01690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5200640 1 -- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00afca0 msgr2=0x7fb4f016bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5200640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00afca0 0x7fb4f016bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5200640 1 -- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f01590b0 msgr2=0x7fb4f01690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5200640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f01590b0 0x7fb4f01690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5200640 1 -- 172.21.15.42:0/2321553891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8009a20 con 0x7fb4f00acf10 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4efe00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00afca0 0x7fb4f016bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f5200640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 0x7fb4f016a2c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c590 tx=0x7fb4e4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4012630 con 0x7fb4f00acf10 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40127b0 con 0x7fb4f00acf10 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4012bb0 con 0x7fb4f00acf10 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.927+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f00c4d90 con 0x7fb4f00acf10 2024-08-17T02:28:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.928+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f006b6d0 con 0x7fb4f00acf10 2024-08-17T02:28:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.929+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f00c4bf0 con 0x7fb4f00acf10 2024-08-17T02:28:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.929+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb4e401a3b0 con 0x7fb4f00acf10 2024-08-17T02:28:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.930+0000 7fb4e3e00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.930+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb4e4082410 con 0x7fb4f00acf10 2024-08-17T02:28:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.930+0000 7fb4efe00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.931+0000 7fb4efe00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00c7920 tx=0x7fb4dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:25.934+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb4f00c4bf0 con 0x7fb4f00acf10 2024-08-17T02:28:26.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:26.140+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000001039443", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4f00c5240 con 0x7fb4d0065150 2024-08-17T02:28:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.012+0000 7fb4e3e00640 1 -- 172.21.15.42:0/2321553891 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fb4dc001d90 con 0x7fb4d0065150 2024-08-17T02:28:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:28:29.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 msgr2=0x7fb4d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00c7920 tx=0x7fb4dc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:29.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 msgr2=0x7fb4f016a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 0x7fb4f016a2c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c590 tx=0x7fb4e4007d80 comp rx=0 tx=0).stop 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 shutdown_connections 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f01590b0 0x7fb4f01690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00afca0 0x7fb4f016bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 --2- 172.21.15.42:0/2321553891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00acf10 0x7fb4f016a2c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 >> 172.21.15.42:0/2321553891 conn(0x7fb4f0066e60 msgr2=0x7fb4f0157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 shutdown_connections 2024-08-17T02:28:29.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.015+0000 7fb4f7c00640 1 -- 172.21.15.42:0/2321553891 wait complete. 2024-08-17T02:28:29.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:29.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.197+0000 7f0e3a600640 1 Processor -- start 2024-08-17T02:28:29.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.197+0000 7f0e3a600640 1 -- start start 2024-08-17T02:28:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e3a600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e340acf10 0x7f0e340b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e3a600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e340c92b0 con 0x7f0e341590b0 2024-08-17T02:28:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e3a600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e340ad480 con 0x7f0e340afca0 2024-08-17T02:28:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e3a600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340b0980 con 0x7f0e340acf10 2024-08-17T02:28:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e2be00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0e341590b0 0x7f0e340c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49102/0 (socket says 172.21.15.42:49102) 2024-08-17T02:28:29.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e2be00640 1 -- 172.21.15.42:0/4096063898 learned_addr learned my addr 172.21.15.42:0/4096063898 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9712629 0 0) 0x7f0e340c92b0 con 0x7f0e341590b0 2024-08-17T02:28:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e33e00640 1 --2- 172.21.15.42:0/4096063898 >> v2:172.21.15.62:3300/0 conn(0x7f0e340acf10 0x7f0e340b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.199+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e180034e0 con 0x7f0e341590b0 2024-08-17T02:28:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348854672 0 0) 0x7f0e180034e0 con 0x7f0e341590b0 2024-08-17T02:28:29.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 >> v2:172.21.15.62:3300/0 conn(0x7f0e340acf10 msgr2=0x7f0e340b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 --2- 172.21.15.42:0/4096063898 >> v2:172.21.15.62:3300/0 conn(0x7f0e340acf10 0x7f0e340b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 >> v1:172.21.15.62:6789/0 conn(0x7f0e340afca0 legacy=0x7f0e341589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340ad760 con 0x7f0e341590b0 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f0e1c001470 con 0x7f0e341590b0 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 >> v1:172.21.15.42:6789/0 conn(0x7f0e341590b0 legacy=0x7f0e340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e18003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e18004780 0x7f0e18004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e18005180 0x7f0e1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1800c0a0 con 0x7f0e18003a20 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1800c1e0 con 0x7f0e18005180 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1800c3a0 con 0x7f0e18004780 2024-08-17T02:28:29.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e33400640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e18003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e2be00640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e18004780 0x7f0e18004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.200+0000 7f0e33e00640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e18005180 0x7f0e1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e33400640 1 -- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e18004780 msgr2=0x7f0e18004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e33400640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e18004780 0x7f0e18004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e33400640 1 -- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e18005180 msgr2=0x7f0e1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e33400640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e18005180 0x7f0e1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e33400640 1 -- 172.21.15.42:0/4096063898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180034e0 con 0x7f0e18003a20 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e33e00640 1 -- 172.21.15.42:0/4096063898 reap_dead start 2024-08-17T02:28:29.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.201+0000 7f0e2be00640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e18004780 0x7f0e18004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e33400640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e18003e30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0e24001800 tx=0x7f0e24007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94c095ad8c7c519 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2402a8e0 con 0x7f0e18003a20 2024-08-17T02:28:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2402aa60 con 0x7f0e18003a20 2024-08-17T02:28:29.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e32a00640 1 -- 172.21.15.42:0/4096063898 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2402ae20 con 0x7f0e18003a20 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e3a600640 1 -- 172.21.15.42:0/4096063898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 msgr2=0x7f0e18003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e3a600640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e18003e30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0e24001800 tx=0x7f0e24007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e3a600640 1 -- 172.21.15.42:0/4096063898 shutdown_connections 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e3a600640 1 --2- 172.21.15.42:0/4096063898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e18003e30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.202+0000 7f0e3a600640 1 -- 172.21.15.42:0/4096063898 >> 172.21.15.42:0/4096063898 conn(0x7f0e34066e60 msgr2=0x7f0e34067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.203+0000 7f0e3a600640 1 -- 172.21.15.42:0/4096063898 shutdown_connections 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.203+0000 7f0e3a600640 1 -- 172.21.15.42:0/4096063898 wait complete. 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.204+0000 7f0e3a600640 1 Processor -- start 2024-08-17T02:28:29.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.204+0000 7f0e3a600640 1 -- start start 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e3a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e34151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e3a600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e3415bf80 0x7f0e3415b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e3a600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e340c63c0 0x7f0e340c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e3a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340c61e0 con 0x7f0e18003a20 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e3a600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340c6d60 con 0x7f0e3415bf80 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e3a600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340c56a0 con 0x7f0e340c63c0 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e33400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e34151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e33400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e34151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39136/0 (socket says 172.21.15.42:39136) 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e33400640 1 -- 172.21.15.42:0/2818507557 learned_addr learned my addr 172.21.15.42:0/2818507557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e2be00640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e3415bf80 0x7f0e3415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.205+0000 7f0e33e00640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e340c63c0 0x7f0e340c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e33400640 1 -- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e340c63c0 msgr2=0x7f0e340c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e33400640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e340c63c0 0x7f0e340c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e33400640 1 -- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e3415bf80 msgr2=0x7f0e3415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e33400640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e3415bf80 0x7f0e3415b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e33400640 1 -- 172.21.15.42:0/2818507557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340c5940 con 0x7f0e18003a20 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e33400640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e34151df0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0e24001800 tx=0x7f0e24003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24040070 con 0x7f0e18003a20 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e240074f0 con 0x7f0e18003a20 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24006a00 con 0x7f0e18003a20 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e340c5c20 con 0x7f0e18003a20 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.206+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e34152330 con 0x7f0e18003a20 2024-08-17T02:28:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.208+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e34152330 con 0x7f0e18003a20 2024-08-17T02:28:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.208+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e24032600 con 0x7f0e18003a20 2024-08-17T02:28:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.209+0000 7f0e2aa00640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e10065220 0x7f0e100676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.209+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0e240a2630 con 0x7f0e18003a20 2024-08-17T02:28:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.210+0000 7f0e2be00640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e10065220 0x7f0e100676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.210+0000 7f0e2be00640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e10065220 0x7f0e100676d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0e3416c290 tx=0x7f0e1c007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.214+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e24070350 con 0x7f0e18003a20 2024-08-17T02:28:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.421+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e34152330 con 0x7f0e10065220 2024-08-17T02:28:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.423+0000 7f0e2aa00640 1 -- 172.21.15.42:0/2818507557 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f0e34152330 con 0x7f0e10065220 2024-08-17T02:28:29.423 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-08-17T02:28:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "cephfs" 2024-08-17T02:28:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-08-17T02:28:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-08-17T02:28:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "volume_0000000001039443" 2024-08-17T02:28:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-08-17T02:28:29.425 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-08-17T02:28:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e10065220 msgr2=0x7f0e100676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e10065220 0x7f0e100676d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0e3416c290 tx=0x7f0e1c007040 comp rx=0 tx=0).stop 2024-08-17T02:28:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 msgr2=0x7f0e34151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e34151df0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0e24001800 tx=0x7f0e24003000 comp rx=0 tx=0).stop 2024-08-17T02:28:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 shutdown_connections 2024-08-17T02:28:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e10065220 0x7f0e100676d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e340c63c0 0x7f0e340c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e3415bf80 0x7f0e3415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 --2- 172.21.15.42:0/2818507557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e18003a20 0x7f0e34151df0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 >> 172.21.15.42:0/2818507557 conn(0x7f0e34066e60 msgr2=0x7f0e340caa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 shutdown_connections 2024-08-17T02:28:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.425+0000 7f0e3a600640 1 -- 172.21.15.42:0/2818507557 wait complete. 2024-08-17T02:28:29.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:28:29.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.594+0000 7f68ef000640 1 Processor -- start 2024-08-17T02:28:29.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.594+0000 7f68ef000640 1 -- start start 2024-08-17T02:28:29.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.595+0000 7f68ef000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68e8158a20 0x7f68e80a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.595+0000 7f68ef000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f68e80ae860 0x7f68e806d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.595+0000 7f68ef000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e8158df0 0x7f68e806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.595+0000 7f68ef000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e80aed90 con 0x7f68e80ae860 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.595+0000 7f68ef000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e80af070 con 0x7f68e8158a20 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.595+0000 7f68ef000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80af350 con 0x7f68e8158df0 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f68e80ae860 0x7f68e806d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f68e80ae860 0x7f68e806d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39148/0 (socket says 172.21.15.42:39148) 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 -- 172.21.15.42:0/3301642875 learned_addr learned my addr 172.21.15.42:0/3301642875 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7e00640 1 --2- 172.21.15.42:0/3301642875 >> v2:172.21.15.62:3300/0 conn(0x7f68e8158a20 0x7f68e80a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68ed000640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e8158df0 0x7f68e806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 -- 172.21.15.42:0/3301642875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e8158df0 msgr2=0x7f68e806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e8158df0 0x7f68e806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 -- 172.21.15.42:0/3301642875 >> v2:172.21.15.62:3300/0 conn(0x7f68e8158a20 msgr2=0x7f68e80a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 --2- 172.21.15.42:0/3301642875 >> v2:172.21.15.62:3300/0 conn(0x7f68e8158a20 0x7f68e80a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7400640 1 -- 172.21.15.42:0/3301642875 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e80af630 con 0x7f68e80ae860 2024-08-17T02:28:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68e7e00640 1 --2- 172.21.15.42:0/3301642875 >> v2:172.21.15.62:3300/0 conn(0x7f68e8158a20 0x7f68e80a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:29.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.596+0000 7f68ed000640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e8158df0 0x7f68e806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.597+0000 7f68e7400640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e80ae860 0x7f68e806d7d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68e8068a60 tx=0x7f68d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b37c760e928afcc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.597+0000 7f68e6a00640 1 -- 172.21.15.42:0/3301642875 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d402add0 con 0x7f68e80ae860 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.597+0000 7f68e6a00640 1 -- 172.21.15.42:0/3301642875 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4032440 con 0x7f68e80ae860 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.597+0000 7f68e6a00640 1 -- 172.21.15.42:0/3301642875 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4032820 con 0x7f68e80ae860 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 -- 172.21.15.42:0/3301642875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e80ae860 msgr2=0x7f68e806d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e80ae860 0x7f68e806d7d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68e8068a60 tx=0x7f68d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 -- 172.21.15.42:0/3301642875 shutdown_connections 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e80ae860 0x7f68e806d7d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 --2- 172.21.15.42:0/3301642875 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e8158df0 0x7f68e806dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 --2- 172.21.15.42:0/3301642875 >> v2:172.21.15.62:3300/0 conn(0x7f68e8158a20 0x7f68e80a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 -- 172.21.15.42:0/3301642875 >> 172.21.15.42:0/3301642875 conn(0x7f68e8066e60 msgr2=0x7f68e8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 -- 172.21.15.42:0/3301642875 shutdown_connections 2024-08-17T02:28:29.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.598+0000 7f68ef000640 1 -- 172.21.15.42:0/3301642875 wait complete. 2024-08-17T02:28:29.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.599+0000 7f68ef000640 1 Processor -- start 2024-08-17T02:28:29.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.600+0000 7f68ef000640 1 -- start start 2024-08-17T02:28:29.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.600+0000 7f68ef000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e80ae860 0x7f68e815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.600+0000 7f68ef000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68e8158a20 0x7f68e813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.600+0000 7f68ef000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 0x7f68e813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ef000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e813d920 con 0x7f68e8158df0 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ef000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e81560d0 con 0x7f68e8158a20 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ef000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e815a710 con 0x7f68e80ae860 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 0x7f68e813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 0x7f68e813d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39150/0 (socket says 172.21.15.42:39150) 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 -- 172.21.15.42:0/55087842 learned_addr learned my addr 172.21.15.42:0/55087842 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68e7400640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68e8158a20 0x7f68e813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68e7e00640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e80ae860 0x7f68e815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 -- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e80ae860 msgr2=0x7f68e815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e80ae860 0x7f68e815eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 -- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68e8158a20 msgr2=0x7f68e813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68e8158a20 0x7f68e813cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68ed000640 1 -- 172.21.15.42:0/55087842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4009450 con 0x7f68e8158df0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.601+0000 7f68e7400640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68e8158a20 0x7f68e813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.602+0000 7f68ed000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 0x7f68e813d3e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68e000cf20 tx=0x7f68e0007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.602+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0016420 con 0x7f68e8158df0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.602+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00165a0 con 0x7f68e8158df0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.602+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0016960 con 0x7f68e8158df0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.602+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e81565c0 con 0x7f68e8158df0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.602+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e8156b80 con 0x7f68e8158df0 2024-08-17T02:28:29.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.603+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e8156da0 con 0x7f68e8158df0 2024-08-17T02:28:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.604+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f68e0016d50 con 0x7f68e8158df0 2024-08-17T02:28:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.604+0000 7f68df400640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68c8065150 0x7f68c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.604+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f68e0012070 con 0x7f68e8158df0 2024-08-17T02:28:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.605+0000 7f68e7e00640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68c8065150 0x7f68c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.605+0000 7f68e7e00640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68c8065150 0x7f68c8067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68d800aa60 tx=0x7f68d8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.609+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f68e004ee40 con 0x7f68e8158df0 2024-08-17T02:28:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.790+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f68e8063fb0 con 0x7f68e8158df0 2024-08-17T02:28:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.791+0000 7f68df400640 1 -- 172.21.15.42:0/55087842 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f68e0050eb0 con 0x7f68e8158df0 2024-08-17T02:28:29.791 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68c8065150 msgr2=0x7f68c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68c8065150 0x7f68c8067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68d800aa60 tx=0x7f68d8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 msgr2=0x7f68e813d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 0x7f68e813d3e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68e000cf20 tx=0x7f68e0007860 comp rx=0 tx=0).stop 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 shutdown_connections 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f68c8065150 0x7f68c8067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68e8158df0 0x7f68e813d3e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68e8158a20 0x7f68e813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 --2- 172.21.15.42:0/55087842 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f68e80ae860 0x7f68e815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 >> 172.21.15.42:0/55087842 conn(0x7f68e8066e60 msgr2=0x7f68e80caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 shutdown_connections 2024-08-17T02:28:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.793+0000 7f68ef000640 1 -- 172.21.15.42:0/55087842 wait complete. 2024-08-17T02:28:29.808 INFO:teuthology.orchestra.run.smithi042.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}] 2024-08-17T02:28:29.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000001039443 --format=json 2024-08-17T02:28:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.960+0000 7f8f61000640 1 Processor -- start 2024-08-17T02:28:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.960+0000 7f8f61000640 1 -- start start 2024-08-17T02:28:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.961+0000 7f8f61000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8f5c0ae860 0x7f8f5c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.961+0000 7f8f61000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.961+0000 7f8f61000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5c0aed90 con 0x7f8f5c158a20 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.961+0000 7f8f61000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5c0af070 con 0x7f8f5c0ae860 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.961+0000 7f8f61000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c0af350 con 0x7f8f5c158df0 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.961+0000 7f8f59400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8f5c0ae860 0x7f8f5c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f59400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8f5c0ae860 0x7f8f5c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39166/0 (socket says 172.21.15.42:39166) 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f59400640 1 -- 172.21.15.42:0/3701207361 learned_addr learned my addr 172.21.15.42:0/3701207361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f5a800640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f59400640 1 -- 172.21.15.42:0/3701207361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 msgr2=0x7f8f5c06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f59400640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c06dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f59400640 1 -- 172.21.15.42:0/3701207361 >> v1:172.21.15.42:6789/0 conn(0x7f8f5c158a20 legacy=0x7f8f5c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f59400640 1 -- 172.21.15.42:0/3701207361 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0af630 con 0x7f8f5c0ae860 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f58a00640 1 -- 172.21.15.42:0/3701207361 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989136472 0 0) 0x7f8f5c0aed90 con 0x7f8f5c158a20 2024-08-17T02:28:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.962+0000 7f8f5a800640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c06dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:29.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.963+0000 7f8f59400640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c06d7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009910 tx=0x7f8f480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9254edd9c5c883 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.963+0000 7f8f58a00640 1 -- 172.21.15.42:0/3701207361 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4802ae40 con 0x7f8f5c0ae860 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.963+0000 7f8f58a00640 1 -- 172.21.15.42:0/3701207361 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48032440 con 0x7f8f5c0ae860 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.963+0000 7f8f58a00640 1 -- 172.21.15.42:0/3701207361 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f480327e0 con 0x7f8f5c0ae860 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 -- 172.21.15.42:0/3701207361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c0ae860 msgr2=0x7f8f5c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c06d7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009910 tx=0x7f8f480091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 -- 172.21.15.42:0/3701207361 shutdown_connections 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c06dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 --2- 172.21.15.42:0/3701207361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c06d7d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 -- 172.21.15.42:0/3701207361 >> 172.21.15.42:0/3701207361 conn(0x7f8f5c066e60 msgr2=0x7f8f5c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 -- 172.21.15.42:0/3701207361 shutdown_connections 2024-08-17T02:28:29.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.964+0000 7f8f61000640 1 -- 172.21.15.42:0/3701207361 wait complete. 2024-08-17T02:28:29.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.965+0000 7f8f61000640 1 Processor -- start 2024-08-17T02:28:29.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.966+0000 7f8f61000640 1 -- start start 2024-08-17T02:28:29.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.966+0000 7f8f61000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c0c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.966+0000 7f8f61000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 0x7f8f5c15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.966+0000 7f8f61000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.966+0000 7f8f61000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c159a00 con 0x7f8f5c158a20 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.966+0000 7f8f61000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c15bb40 con 0x7f8f5c0ae860 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f61000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c15b860 con 0x7f8f5c158df0 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 0x7f8f5c15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 0x7f8f5c15af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39178/0 (socket says 172.21.15.42:39178) 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 -- 172.21.15.42:0/397185325 learned_addr learned my addr 172.21.15.42:0/397185325 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f5a800640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59e00640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c0c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 -- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 msgr2=0x7f8f5c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 -- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f5c0ae860 msgr2=0x7f8f5c0c07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c0c07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.967+0000 7f8f59400640 1 -- 172.21.15.42:0/397185325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48009450 con 0x7f8f5c158a20 2024-08-17T02:28:29.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.968+0000 7f8f59400640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 0x7f8f5c15af60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009940 tx=0x7f8f48032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.968+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48031a90 con 0x7f8f5c158a20 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.968+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f48031c10 con 0x7f8f5c158a20 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.968+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5c1593b0 con 0x7f8f5c158a20 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.968+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4803e450 con 0x7f8f5c158a20 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.968+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5c15b4a0 con 0x7f8f5c158a20 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.969+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5c159210 con 0x7f8f5c158a20 2024-08-17T02:28:29.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.970+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8f4803c400 con 0x7f8f5c158a20 2024-08-17T02:28:29.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.970+0000 7f8f51600640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8f3c065150 0x7f8f3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.971+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8f4802ae40 con 0x7f8f5c158a20 2024-08-17T02:28:29.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.971+0000 7f8f59e00640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8f3c065150 0x7f8f3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.971+0000 7f8f59e00640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8f3c065150 0x7f8f3c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0011e0 tx=0x7f8f4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:29.975+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8f5c159210 con 0x7f8f5c158a20 2024-08-17T02:28:30.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.214+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000001039443", "format": "json"} v 0) v1 -- 0x7f8f5c159210 con 0x7f8f5c158a20 2024-08-17T02:28:30.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.215+0000 7f8f51600640 1 -- 172.21.15.42:0/397185325 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000001039443", "format": "json"}]=0 v19) v1 ==== 110+0+1844 (secure 0 0 0) 0x7f8f48037750 con 0x7f8f5c158a20 2024-08-17T02:28:30.215 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:28:30.215 INFO:teuthology.orchestra.run.smithi042.stdout:{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:28:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8f3c065150 msgr2=0x7f8f3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8f3c065150 0x7f8f3c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0011e0 tx=0x7f8f4c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 msgr2=0x7f8f5c15af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 0x7f8f5c15af60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009940 tx=0x7f8f48032000 comp rx=0 tx=0).stop 2024-08-17T02:28:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 shutdown_connections 2024-08-17T02:28:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8f3c065150 0x7f8f3c067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f5c158df0 0x7f8f5c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f5c158a20 0x7f8f5c15af60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 --2- 172.21.15.42:0/397185325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f5c0ae860 0x7f8f5c0c07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 >> 172.21.15.42:0/397185325 conn(0x7f8f5c066e60 msgr2=0x7f8f5c0ad140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 shutdown_connections 2024-08-17T02:28:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.217+0000 7f8f61000640 1 -- 172.21.15.42:0/397185325 wait complete. 2024-08-17T02:28:30.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039443 --yes-i-really-mean-it 2024-08-17T02:28:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.385+0000 7f995f200640 1 Processor -- start 2024-08-17T02:28:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.386+0000 7f995f200640 1 -- start start 2024-08-17T02:28:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.387+0000 7f995f200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9960157560 0x7f99600ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.387+0000 7f995f200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600ad690 con 0x7f99600acce0 2024-08-17T02:28:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.387+0000 7f995f200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600696e0 con 0x7f996014c9e0 2024-08-17T02:28:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.387+0000 7f995f200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99600699c0 con 0x7f9960157560 2024-08-17T02:28:30.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.387+0000 7f995d400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f99600acce0 0x7f9960156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49124/0 (socket says 172.21.15.42:49124) 2024-08-17T02:28:30.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.387+0000 7f995d400640 1 -- 172.21.15.42:0/771339524 learned_addr learned my addr 172.21.15.42:0/771339524 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:28:30.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995e800640 1 --2- 172.21.15.42:0/771339524 >> v2:172.21.15.62:3300/0 conn(0x7f9960157560 0x7f99600ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400050189 0 0) 0x7f99600ad690 con 0x7f99600acce0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99440034e0 con 0x7f99600acce0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527896373 0 0) 0x7f99600696e0 con 0x7f996014c9e0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99600ad690 con 0x7f996014c9e0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3966020873 0 0) 0x7f99440034e0 con 0x7f99600acce0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 >> v2:172.21.15.62:3300/0 conn(0x7f9960157560 msgr2=0x7f99600ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 --2- 172.21.15.42:0/771339524 >> v2:172.21.15.62:3300/0 conn(0x7f9960157560 0x7f99600ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 >> v1:172.21.15.62:6789/0 conn(0x7f996014c9e0 legacy=0x7f99600cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960069ca0 con 0x7f99600acce0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f994c001470 con 0x7f99600acce0 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 >> v1:172.21.15.42:6789/0 conn(0x7f99600acce0 legacy=0x7f9960156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944003bb0 0x7f9944003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9944004780 0x7f9944004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9944005180 0x7f994400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99600699c0 con 0x7f9944005180 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994400c0a0 con 0x7f9944004780 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994400c230 con 0x7f9944003bb0 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995e800640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9944005180 0x7f994400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995d400640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9944004780 0x7f9944004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.388+0000 7f995de00640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944003bb0 0x7f9944003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.389+0000 7f995e800640 1 -- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944003bb0 msgr2=0x7f9944003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.389+0000 7f995e800640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944003bb0 0x7f9944003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.389+0000 7f995e800640 1 -- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9944004780 msgr2=0x7f9944004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.389+0000 7f995e800640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9944004780 0x7f9944004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.389+0000 7f995e800640 1 -- 172.21.15.42:0/771339524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440034e0 con 0x7f9944005180 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995e800640 1 -- 172.21.15.42:0/771339524 reap_dead start 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995e800640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9944005180 0x7f994400b9d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f995800e240 tx=0x7f995800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afa4fa9032037d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958030440 con 0x7f9944005180 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995800f040 con 0x7f9944005180 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995ca00640 1 -- 172.21.15.42:0/771339524 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580305e0 con 0x7f9944005180 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995f200640 1 -- 172.21.15.42:0/771339524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9944005180 msgr2=0x7f994400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.390+0000 7f995f200640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9944005180 0x7f994400b9d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f995800e240 tx=0x7f995800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.391+0000 7f995f200640 1 -- 172.21.15.42:0/771339524 shutdown_connections 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.391+0000 7f995f200640 1 --2- 172.21.15.42:0/771339524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9944005180 0x7f994400b9d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.391+0000 7f995f200640 1 -- 172.21.15.42:0/771339524 >> 172.21.15.42:0/771339524 conn(0x7f9960067930 msgr2=0x7f99600cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.391+0000 7f995f200640 1 -- 172.21.15.42:0/771339524 shutdown_connections 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.391+0000 7f995f200640 1 -- 172.21.15.42:0/771339524 wait complete. 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.392+0000 7f995f200640 1 Processor -- start 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.392+0000 7f995f200640 1 -- start start 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995f200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944005180 0x7f99601542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99601689d0 0x7f99600abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99600ac460 0x7f9960150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960169220 con 0x7f99600ac460 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960169500 con 0x7f99601689d0 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995f200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99601697e0 con 0x7f9944005180 2024-08-17T02:28:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99600ac460 0x7f9960150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99600ac460 0x7f9960150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39202/0 (socket says 172.21.15.42:39202) 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995e800640 1 -- 172.21.15.42:0/3861558382 learned_addr learned my addr 172.21.15.42:0/3861558382 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995de00640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944005180 0x7f99601542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.393+0000 7f995d400640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99601689d0 0x7f99600abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995e800640 1 -- 172.21.15.42:0/3861558382 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944005180 msgr2=0x7f99601542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995e800640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9944005180 0x7f99601542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995e800640 1 -- 172.21.15.42:0/3861558382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99601689d0 msgr2=0x7f99600abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995e800640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f99601689d0 0x7f99600abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995e800640 1 -- 172.21.15.42:0/3861558382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960169ac0 con 0x7f99600ac460 2024-08-17T02:28:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995e800640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99600ac460 0x7f9960150620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99580094d0 tx=0x7f9958035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f9955600640 1 -- 172.21.15.42:0/3861558382 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958030e80 con 0x7f99600ac460 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f9955600640 1 -- 172.21.15.42:0/3861558382 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958038610 con 0x7f99600ac460 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f9955600640 1 -- 172.21.15.42:0/3861558382 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580389d0 con 0x7f99600ac460 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995f200640 1 -- 172.21.15.42:0/3861558382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9960169da0 con 0x7f99600ac460 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.394+0000 7f995f200640 1 -- 172.21.15.42:0/3861558382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9960150b60 con 0x7f99600ac460 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.396+0000 7f995f200640 1 -- 172.21.15.42:0/3861558382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9960169f90 con 0x7f99600ac460 2024-08-17T02:28:30.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.396+0000 7f9955600640 1 -- 172.21.15.42:0/3861558382 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9958003020 con 0x7f99600ac460 2024-08-17T02:28:30.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.397+0000 7f9955600640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9940065180 0x7f9940067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.397+0000 7f9955600640 1 -- 172.21.15.42:0/3861558382 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f99580a2bf0 con 0x7f99600ac460 2024-08-17T02:28:30.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.397+0000 7f995de00640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9940065180 0x7f9940067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.398+0000 7f995de00640 1 --2- 172.21.15.42:0/3861558382 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9940065180 0x7f9940067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9950007db0 tx=0x7f9950007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.401+0000 7f9955600640 1 -- 172.21.15.42:0/3861558382 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f99580709e0 con 0x7f99600ac460 2024-08-17T02:28:30.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:28:30.605+0000 7f995f200640 1 -- 172.21.15.42:0/3861558382 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000001039443", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f9960169670 con 0x7f9940065180 2024-08-17T02:28:34.866 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-08-17T02:28:34.865+0000 7f8530e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:49.877 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:49.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:19.976 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:19.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:50.073 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:50.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:20.171 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:20.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:30.303 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:30:30.303 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:30:30.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:30.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:30.498 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:30:30.498 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:30:30.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:30:30.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:30.568 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:30:30.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:30.568 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:30:30.605 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:30:30.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:30:30.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:30.671 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:30:30.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:30.672 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:30:30.708 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:30.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.860+0000 7f35daa00640 1 Processor -- start 2024-08-17T02:30:30.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.860+0000 7f35daa00640 1 -- start start 2024-08-17T02:30:30.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.861+0000 7f35daa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f35d40ca050 0x7f35d4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.861+0000 7f35daa00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f35d40add30 0x7f35d415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.861+0000 7f35daa00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d415b5e0 con 0x7f35d40ad960 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35daa00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40cb160 con 0x7f35d40add30 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35daa00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40b0d10 con 0x7f35d40ca050 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f35d40add30 0x7f35d415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f35d40add30 0x7f35d415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55386/0 (socket says 172.21.15.42:55386) 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 -- 172.21.15.42:0/751611838 learned_addr learned my addr 172.21.15.42:0/751611838 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d3400640 1 --2- 172.21.15.42:0/751611838 >> v2:172.21.15.62:3300/0 conn(0x7f35d40ca050 0x7f35d4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 -- 172.21.15.42:0/751611838 >> v2:172.21.15.62:3300/0 conn(0x7f35d40ca050 msgr2=0x7f35d4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 --2- 172.21.15.42:0/751611838 >> v2:172.21.15.62:3300/0 conn(0x7f35d40ca050 0x7f35d4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 -- 172.21.15.42:0/751611838 >> v1:172.21.15.62:6789/0 conn(0x7f35d40ad960 legacy=0x7f35d4156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:30.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.862+0000 7f35d8a00640 1 -- 172.21.15.42:0/751611838 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40ca550 con 0x7f35d40add30 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.863+0000 7f35d8a00640 1 --2- 172.21.15.42:0/751611838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40add30 0x7f35d415b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f35d4063600 tx=0x7f35cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a9aad8c378d0e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35d2a00640 1 -- 172.21.15.42:0/751611838 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc032470 con 0x7f35d40add30 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35d2a00640 1 -- 172.21.15.42:0/751611838 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc0325d0 con 0x7f35d40add30 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35d2a00640 1 -- 172.21.15.42:0/751611838 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0329b0 con 0x7f35d40add30 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 -- 172.21.15.42:0/751611838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40add30 msgr2=0x7f35d415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 --2- 172.21.15.42:0/751611838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40add30 0x7f35d415b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f35d4063600 tx=0x7f35cc009840 comp rx=0 tx=0).stop 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 -- 172.21.15.42:0/751611838 shutdown_connections 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 --2- 172.21.15.42:0/751611838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40add30 0x7f35d415b0a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 --2- 172.21.15.42:0/751611838 >> v2:172.21.15.62:3300/0 conn(0x7f35d40ca050 0x7f35d4156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 -- 172.21.15.42:0/751611838 >> 172.21.15.42:0/751611838 conn(0x7f35d4066e60 msgr2=0x7f35d4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 -- 172.21.15.42:0/751611838 shutdown_connections 2024-08-17T02:30:30.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.864+0000 7f35daa00640 1 -- 172.21.15.42:0/751611838 wait complete. 2024-08-17T02:30:30.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.866+0000 7f35daa00640 1 Processor -- start 2024-08-17T02:30:30.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.866+0000 7f35daa00640 1 -- start start 2024-08-17T02:30:30.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35daa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 0x7f35d40a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35daa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35d40add30 0x7f35d40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35daa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35d40ca050 0x7f35d40a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35daa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4167ee0 con 0x7f35d40ad960 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35daa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40a5560 con 0x7f35d40ca050 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35daa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40aa690 con 0x7f35d40add30 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 0x7f35d40a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 0x7f35d40a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55402/0 (socket says 172.21.15.42:55402) 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 -- 172.21.15.42:0/466311526 learned_addr learned my addr 172.21.15.42:0/466311526 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d8a00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35d40ca050 0x7f35d40a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 -- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35d40add30 msgr2=0x7f35d40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35d40add30 0x7f35d40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 -- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35d40ca050 msgr2=0x7f35d40a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35d40ca050 0x7f35d40a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d3e00640 1 -- 172.21.15.42:0/466311526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc009ae0 con 0x7f35d40ad960 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.867+0000 7f35d8a00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35d40ca050 0x7f35d40a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.868+0000 7f35d3e00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 0x7f35d40a59f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f35c400c4f0 tx=0x7f35c4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:30.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.868+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011590 con 0x7f35d40ad960 2024-08-17T02:30:30.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.868+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4011710 con 0x7f35d40ad960 2024-08-17T02:30:30.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.868+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d40a4c30 con 0x7f35d40ad960 2024-08-17T02:30:30.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.868+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4011ad0 con 0x7f35d40ad960 2024-08-17T02:30:30.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.868+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40a51f0 con 0x7f35d40ad960 2024-08-17T02:30:30.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.869+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d40a4980 con 0x7f35d40ad960 2024-08-17T02:30:30.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.870+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f35c401a360 con 0x7f35d40ad960 2024-08-17T02:30:30.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.871+0000 7f35cb400640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f35b4065150 0x7f35b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:30.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.871+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f35c4081650 con 0x7f35d40ad960 2024-08-17T02:30:30.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.871+0000 7f35d3400640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f35b4065150 0x7f35b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:30.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.872+0000 7f35d3400640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f35b4065150 0x7f35b4067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006fd0 tx=0x7f35c0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:30.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:30.876+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f35c404f2f0 con 0x7f35d40ad960 2024-08-17T02:30:31.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.099+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35d415b5e0 con 0x7f35d40ad960 2024-08-17T02:30:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.100+0000 7f35cb400640 1 -- 172.21.15.42:0/466311526 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f35d415b5e0 con 0x7f35d40ad960 2024-08-17T02:30:31.100 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:31.100 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:15.308187+0000","modified":"2024-08-17T02:28:18.906436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4887},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4887":{"gid":4887,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6836/3869657839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3869657839},{"type":"v1","addr":"172.21.15.42:6836","nonce":3869657839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 19 2024-08-17T02:30:31.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f35b4065150 msgr2=0x7f35b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f35b4065150 0x7f35b4067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f35c0006fd0 tx=0x7f35c0008040 comp rx=0 tx=0).stop 2024-08-17T02:30:31.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 msgr2=0x7f35d40a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 0x7f35d40a59f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f35c400c4f0 tx=0x7f35c4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 shutdown_connections 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f35b4065150 0x7f35b4067600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35d40ca050 0x7f35d40a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f35d40add30 0x7f35d40aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 --2- 172.21.15.42:0/466311526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35d40ad960 0x7f35d40a59f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 >> 172.21.15.42:0/466311526 conn(0x7f35d4066e60 msgr2=0x7f35d406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 shutdown_connections 2024-08-17T02:30:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.102+0000 7f35daa00640 1 -- 172.21.15.42:0/466311526 wait complete. 2024-08-17T02:30:31.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:31.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.269+0000 7f1177400640 1 Processor -- start 2024-08-17T02:30:31.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.269+0000 7f1177400640 1 -- start start 2024-08-17T02:30:31.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.270+0000 7f1177400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11701590b0 0x7f11700b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.270+0000 7f1177400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700c92b0 con 0x7f11700afca0 2024-08-17T02:30:31.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.270+0000 7f1177400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700ad480 con 0x7f11700acf10 2024-08-17T02:30:31.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.270+0000 7f1177400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b0980 con 0x7f11701590b0 2024-08-17T02:30:31.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f1174a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f11700afca0 0x7f11701589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38504/0 (socket says 172.21.15.42:38504) 2024-08-17T02:30:31.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f1174a00640 1 -- 172.21.15.42:0/603460506 learned_addr learned my addr 172.21.15.42:0/603460506 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:31.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116fe00640 1 --2- 172.21.15.42:0/603460506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11701590b0 0x7f11700b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219267089 0 0) 0x7f11700c92b0 con 0x7f11700afca0 2024-08-17T02:30:31.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11580034e0 con 0x7f11700afca0 2024-08-17T02:30:31.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249577652 0 0) 0x7f11700ad480 con 0x7f11700acf10 2024-08-17T02:30:31.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11700c92b0 con 0x7f11700acf10 2024-08-17T02:30:31.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116fe00640 1 -- 172.21.15.42:0/603460506 >> v1:172.21.15.62:6789/0 conn(0x7f11700acf10 legacy=0x7f11700c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116fe00640 1 -- 172.21.15.42:0/603460506 >> v1:172.21.15.42:6789/0 conn(0x7f11700afca0 legacy=0x7f11701589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.271+0000 7f116fe00640 1 -- 172.21.15.42:0/603460506 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700ad760 con 0x7f11701590b0 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f116fe00640 1 --2- 172.21.15.42:0/603460506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11701590b0 0x7f11700b0070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f115c009880 tx=0x7f115c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64ce2a98a3a1046 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c02ae10 con 0x7f11701590b0 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c032440 con 0x7f11701590b0 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f116f400640 1 -- 172.21.15.42:0/603460506 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0327e0 con 0x7f11701590b0 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f1177400640 1 -- 172.21.15.42:0/603460506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11701590b0 msgr2=0x7f11700b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f1177400640 1 --2- 172.21.15.42:0/603460506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11701590b0 0x7f11700b0070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f115c009880 tx=0x7f115c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f1177400640 1 -- 172.21.15.42:0/603460506 shutdown_connections 2024-08-17T02:30:31.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f1177400640 1 --2- 172.21.15.42:0/603460506 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11701590b0 0x7f11700b0070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.273+0000 7f1177400640 1 -- 172.21.15.42:0/603460506 >> 172.21.15.42:0/603460506 conn(0x7f1170066e60 msgr2=0x7f1170067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.274+0000 7f1177400640 1 -- 172.21.15.42:0/603460506 shutdown_connections 2024-08-17T02:30:31.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.274+0000 7f1177400640 1 -- 172.21.15.42:0/603460506 wait complete. 2024-08-17T02:30:31.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.275+0000 7f1177400640 1 Processor -- start 2024-08-17T02:30:31.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.275+0000 7f1177400640 1 -- start start 2024-08-17T02:30:31.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1177400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11700acf10 0x7f11700c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1177400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 0x7f1170157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1177400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11701590b0 0x7f11700c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1177400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700c3370 con 0x7f11700afca0 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1177400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11700c1d90 con 0x7f11701590b0 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1177400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700c2070 con 0x7f11700acf10 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f116fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 0x7f1170157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f116fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 0x7f1170157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55410/0 (socket says 172.21.15.42:55410) 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f116fe00640 1 -- 172.21.15.42:0/526645879 learned_addr learned my addr 172.21.15.42:0/526645879 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1174a00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11700acf10 0x7f11700c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.276+0000 7f1175400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11701590b0 0x7f11700c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f116fe00640 1 -- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11700acf10 msgr2=0x7f11700c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f116fe00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11700acf10 0x7f11700c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f116fe00640 1 -- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11701590b0 msgr2=0x7f11700c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f116fe00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11701590b0 0x7f11700c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f116fe00640 1 -- 172.21.15.42:0/526645879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009390 con 0x7f11700afca0 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f1175400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11701590b0 0x7f11700c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f116fe00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 0x7f1170157420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f115c009880 tx=0x7f115c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c000c40 con 0x7f11700afca0 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c031a60 con 0x7f11700afca0 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c031e20 con 0x7f11700afca0 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11700c2350 con 0x7f11700afca0 2024-08-17T02:30:31.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.277+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170157960 con 0x7f11700afca0 2024-08-17T02:30:31.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.278+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170063fb0 con 0x7f11700afca0 2024-08-17T02:30:31.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.279+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f115c039040 con 0x7f11700afca0 2024-08-17T02:30:31.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.280+0000 7f1163e00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1150065150 0x7f1150067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.280+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f115c0a22f0 con 0x7f11700afca0 2024-08-17T02:30:31.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.280+0000 7f1174a00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1150065150 0x7f1150067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.281+0000 7f1174a00640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1150065150 0x7f1150067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1164005840 tx=0x7f1164009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.284+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f115c070040 con 0x7f11700afca0 2024-08-17T02:30:31.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.466+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1170067b70 con 0x7f11700afca0 2024-08-17T02:30:31.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.467+0000 7f1163e00640 1 -- 172.21.15.42:0/526645879 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f115c073660 con 0x7f11700afca0 2024-08-17T02:30:31.467 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:31.468 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:31.012089+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:31.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1150065150 msgr2=0x7f1150067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1150065150 0x7f1150067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1164005840 tx=0x7f1164009040 comp rx=0 tx=0).stop 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 msgr2=0x7f1170157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 0x7f1170157420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f115c009880 tx=0x7f115c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 shutdown_connections 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1150065150 0x7f1150067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11701590b0 0x7f11700c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11700afca0 0x7f1170157420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 --2- 172.21.15.42:0/526645879 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11700acf10 0x7f11700c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 >> 172.21.15.42:0/526645879 conn(0x7f1170066e60 msgr2=0x7f11700ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 shutdown_connections 2024-08-17T02:30:31.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.469+0000 7f1177400640 1 -- 172.21.15.42:0/526645879 wait complete. 2024-08-17T02:30:31.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:28:13.459105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:28:14.291948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001039443.meta', 'create_time': '2024-08-17T02:28:26.181709+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001039443'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001039443.data', 'create_time': '2024-08-17T02:28:27.046060+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001039443'}}}] 2024-08-17T02:30:31.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.640+0000 7f7eedc00640 1 Processor -- start 2024-08-17T02:30:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.640+0000 7f7eedc00640 1 -- start start 2024-08-17T02:30:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.641+0000 7f7eedc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee8153400 0x7f7ee8069100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.641+0000 7f7eedc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7ee81537d0 0x7f7ee815a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.641+0000 7f7eedc00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ee80683b0 0x7f7ee80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.641+0000 7f7eedc00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80cde70 con 0x7f7ee80683b0 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.641+0000 7f7eedc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80b5b90 con 0x7f7ee81537d0 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.641+0000 7f7eedc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80ce130 con 0x7f7ee8153400 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ee80683b0 0x7f7ee80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ee80683b0 0x7f7ee80687d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55420/0 (socket says 172.21.15.42:55420) 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 -- 172.21.15.42:0/2997928779 learned_addr learned my addr 172.21.15.42:0/2997928779 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee6000640 1 --2- 172.21.15.42:0/2997928779 >> v2:172.21.15.62:3300/0 conn(0x7f7ee81537d0 0x7f7ee815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee6a00640 1 --2- 172.21.15.42:0/2997928779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee8153400 0x7f7ee8069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 -- 172.21.15.42:0/2997928779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee8153400 msgr2=0x7f7ee8069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 --2- 172.21.15.42:0/2997928779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee8153400 0x7f7ee8069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 -- 172.21.15.42:0/2997928779 >> v2:172.21.15.62:3300/0 conn(0x7f7ee81537d0 msgr2=0x7f7ee815a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 --2- 172.21.15.42:0/2997928779 >> v2:172.21.15.62:3300/0 conn(0x7f7ee81537d0 0x7f7ee815a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.642+0000 7f7ee7400640 1 -- 172.21.15.42:0/2997928779 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8068d10 con 0x7f7ee80683b0 2024-08-17T02:30:31.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.643+0000 7f7ee7400640 1 --2- 172.21.15.42:0/2997928779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee80687d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8064760 tx=0x7f7ee0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee96562fe5ab1a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.643+0000 7f7ee5600640 1 -- 172.21.15.42:0/2997928779 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0031400 con 0x7f7ee80683b0 2024-08-17T02:30:31.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.643+0000 7f7ee5600640 1 -- 172.21.15.42:0/2997928779 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee002d050 con 0x7f7ee80683b0 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.643+0000 7f7ee5600640 1 -- 172.21.15.42:0/2997928779 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00317d0 con 0x7f7ee80683b0 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 -- 172.21.15.42:0/2997928779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 msgr2=0x7f7ee80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 --2- 172.21.15.42:0/2997928779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee80687d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8064760 tx=0x7f7ee0009840 comp rx=0 tx=0).stop 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 -- 172.21.15.42:0/2997928779 shutdown_connections 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 --2- 172.21.15.42:0/2997928779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee80687d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 --2- 172.21.15.42:0/2997928779 >> v2:172.21.15.62:3300/0 conn(0x7f7ee81537d0 0x7f7ee815a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 --2- 172.21.15.42:0/2997928779 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee8153400 0x7f7ee8069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 -- 172.21.15.42:0/2997928779 >> 172.21.15.42:0/2997928779 conn(0x7f7ee80d07c0 msgr2=0x7f7ee80b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 -- 172.21.15.42:0/2997928779 shutdown_connections 2024-08-17T02:30:31.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.644+0000 7f7eedc00640 1 -- 172.21.15.42:0/2997928779 wait complete. 2024-08-17T02:30:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.645+0000 7f7eedc00640 1 Processor -- start 2024-08-17T02:30:31.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 -- start start 2024-08-17T02:30:31.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee8154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ee8153400 0x7f7ee8145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee81537d0 0x7f7ee815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8157110 con 0x7f7ee80683b0 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81550e0 con 0x7f7ee8153400 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.646+0000 7f7eedc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8155310 con 0x7f7ee81537d0 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee8154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee8154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55430/0 (socket says 172.21.15.42:55430) 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 -- 172.21.15.42:0/3521825360 learned_addr learned my addr 172.21.15.42:0/3521825360 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6000640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ee8153400 0x7f7ee8145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee7400640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee81537d0 0x7f7ee815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 -- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee81537d0 msgr2=0x7f7ee815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee81537d0 0x7f7ee815b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 -- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ee8153400 msgr2=0x7f7ee8145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ee8153400 0x7f7ee8145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.647+0000 7f7ee6a00640 1 -- 172.21.15.42:0/3521825360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009ae0 con 0x7f7ee80683b0 2024-08-17T02:30:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.648+0000 7f7ee6a00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee8154ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800ea20 tx=0x7f7ed80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.648+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800ca10 con 0x7f7ee80683b0 2024-08-17T02:30:31.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.648+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800cb70 con 0x7f7ee80683b0 2024-08-17T02:30:31.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.648+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8013470 con 0x7f7ee80683b0 2024-08-17T02:30:31.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.648+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee81555f0 con 0x7f7ee80683b0 2024-08-17T02:30:31.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.648+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8155bb0 con 0x7f7ee80683b0 2024-08-17T02:30:31.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.649+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee815a510 con 0x7f7ee80683b0 2024-08-17T02:30:31.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.650+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7ed8013860 con 0x7f7ee80683b0 2024-08-17T02:30:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.651+0000 7f7ede000640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ec8065150 0x7f7ec8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.651+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7ed8082ab0 con 0x7f7ee80683b0 2024-08-17T02:30:31.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.651+0000 7f7ee6000640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ec8065150 0x7f7ec8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:31.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.652+0000 7f7ee6000640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ec8065150 0x7f7ec8067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8156500 tx=0x7f7ed40090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:31.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.655+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7ed8050800 con 0x7f7ee80683b0 2024-08-17T02:30:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.835+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ee8063fb0 con 0x7f7ee80683b0 2024-08-17T02:30:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.835+0000 7f7ede000640 1 -- 172.21.15.42:0/3521825360 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ed8053e20 con 0x7f7ee80683b0 2024-08-17T02:30:31.835 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:30:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ec8065150 msgr2=0x7f7ec8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ec8065150 0x7f7ec8067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8156500 tx=0x7f7ed40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 msgr2=0x7f7ee8154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee8154ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800ea20 tx=0x7f7ed80090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 shutdown_connections 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7ec8065150 0x7f7ec8067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7ee81537d0 0x7f7ee815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7ee8153400 0x7f7ee8145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 --2- 172.21.15.42:0/3521825360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ee80683b0 0x7f7ee8154ba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 >> 172.21.15.42:0/3521825360 conn(0x7f7ee80d07c0 msgr2=0x7f7ee815be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 shutdown_connections 2024-08-17T02:30:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:31.837+0000 7f7eedc00640 1 -- 172.21.15.42:0/3521825360 wait complete. 2024-08-17T02:30:31.852 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:30:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.009+0000 7fc9b7a00640 1 Processor -- start 2024-08-17T02:30:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.009+0000 7fc9b7a00640 1 -- start start 2024-08-17T02:30:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9b7a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9b0158a20 0x7fc9b00a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9b7a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 0x7fc9b00afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9b7a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b00aed90 con 0x7fc9b00ae860 2024-08-17T02:30:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9b7a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b00af070 con 0x7fc9b0158a20 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9b7a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00af350 con 0x7fc9b006dee0 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9afe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc9b00ae860 0x7fc9b006d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38516/0 (socket says 172.21.15.42:38516) 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.010+0000 7fc9afe00640 1 -- 172.21.15.42:0/3380824263 learned_addr learned my addr 172.21.15.42:0/3380824263 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9b5000640 1 --2- 172.21.15.42:0/3380824263 >> v2:172.21.15.62:3300/0 conn(0x7fc9b0158a20 0x7fc9b00a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9b5a00640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 0x7fc9b00afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691452024 0 0) 0x7fc9b00aed90 con 0x7fc9b00ae860 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9980034e0 con 0x7fc9b00ae860 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717484629 0 0) 0x7fc9980034e0 con 0x7fc9b00ae860 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 msgr2=0x7fc9b00afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 0x7fc9b00afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 >> v2:172.21.15.62:3300/0 conn(0x7fc9b0158a20 msgr2=0x7fc9b00a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 --2- 172.21.15.42:0/3380824263 >> v2:172.21.15.62:3300/0 conn(0x7fc9b0158a20 0x7fc9b00a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b00af630 con 0x7fc9b00ae860 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fc99c001470 con 0x7fc9b00ae860 2024-08-17T02:30:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 >> v1:172.21.15.42:6789/0 conn(0x7fc9b00ae860 legacy=0x7fc9b006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc998003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc998004780 0x7fc998004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 0x7fc998005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00af070 con 0x7fc9980039d0 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b00af350 con 0x7fc998004780 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.011+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99800b9d0 con 0x7fc9b006dee0 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5000640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc998003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5a00640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 0x7fc998005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9afe00640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc998004780 0x7fc998004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5000640 1 -- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 msgr2=0x7fc998005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5000640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b006dee0 0x7fc998005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5000640 1 -- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc998004780 msgr2=0x7fc998004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5000640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc998004780 0x7fc998004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.012+0000 7fc9b5000640 1 -- 172.21.15.42:0/3380824263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9980034e0 con 0x7fc9980039d0 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.013+0000 7fc9b5000640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc998003de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009ba0 tx=0x7fc9a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26a58385de5e291 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.013+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4031400 con 0x7fc9980039d0 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.013+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a402d050 con 0x7fc9980039d0 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.013+0000 7fc9af400640 1 -- 172.21.15.42:0/3380824263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4031790 con 0x7fc9980039d0 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b7a00640 1 -- 172.21.15.42:0/3380824263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 msgr2=0x7fc998003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/3380824263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc998003de0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009ba0 tx=0x7fc9a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b5a00640 1 -- 172.21.15.42:0/3380824263 reap_dead start 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b7a00640 1 -- 172.21.15.42:0/3380824263 shutdown_connections 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b7a00640 1 -- 172.21.15.42:0/3380824263 >> 172.21.15.42:0/3380824263 conn(0x7fc9b0066e60 msgr2=0x7fc9b0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b7a00640 1 -- 172.21.15.42:0/3380824263 shutdown_connections 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.014+0000 7fc9b7a00640 1 -- 172.21.15.42:0/3380824263 wait complete. 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.015+0000 7fc9b7a00640 1 Processor -- start 2024-08-17T02:30:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.015+0000 7fc9b7a00640 1 -- start start 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.016+0000 7fc9b7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc9b013b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.016+0000 7fc9b7a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9b0155720 0x7fc9b0155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.016+0000 7fc9b7a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b014ddc0 0x7fc9b014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.016+0000 7fc9b7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b014d930 con 0x7fc9980039d0 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.016+0000 7fc9b7a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b014e770 con 0x7fc9b0155720 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.016+0000 7fc9b7a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b014cd20 con 0x7fc9b014ddc0 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc9b013b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc9b013b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55448/0 (socket says 172.21.15.42:55448) 2024-08-17T02:30:32.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 -- 172.21.15.42:0/418374749 learned_addr learned my addr 172.21.15.42:0/418374749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9afe00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9b0155720 0x7fc9b0155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b014ddc0 0x7fc9b014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 -- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b014ddc0 msgr2=0x7fc9b014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b014ddc0 0x7fc9b014e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 -- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9b0155720 msgr2=0x7fc9b0155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9b0155720 0x7fc9b0155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 -- 172.21.15.42:0/418374749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b014d000 con 0x7fc9980039d0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.017+0000 7fc9b5000640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc9b013b290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009c00 tx=0x7fc9a4035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.018+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a403b4f0 con 0x7fc9980039d0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.018+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a4040070 con 0x7fc9980039d0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.018+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a403b8a0 con 0x7fc9980039d0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.018+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b014d2e0 con 0x7fc9980039d0 2024-08-17T02:30:32.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.018+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b013b7d0 con 0x7fc9980039d0 2024-08-17T02:30:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.019+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b0063fb0 con 0x7fc9980039d0 2024-08-17T02:30:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.020+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc9a4042030 con 0x7fc9980039d0 2024-08-17T02:30:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.020+0000 7fc9a3e00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc990065180 0x7fc990067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.021+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc9a40a3620 con 0x7fc9980039d0 2024-08-17T02:30:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.021+0000 7fc9afe00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc990065180 0x7fc990067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.021+0000 7fc9afe00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc990065180 0x7fc990067630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9b014e9a0 tx=0x7fc99c007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.025+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9a40714d0 con 0x7fc9980039d0 2024-08-17T02:30:32.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.205+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9b006e4c0 con 0x7fc9980039d0 2024-08-17T02:30:32.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.205+0000 7fc9a3e00640 1 -- 172.21.15.42:0/418374749 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9a4074af0 con 0x7fc9980039d0 2024-08-17T02:30:32.206 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc990065180 msgr2=0x7fc990067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc990065180 0x7fc990067630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc9b014e9a0 tx=0x7fc99c007040 comp rx=0 tx=0).stop 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 msgr2=0x7fc9b013b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc9b013b290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009c00 tx=0x7fc9a4035000 comp rx=0 tx=0).stop 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 shutdown_connections 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc990065180 0x7fc990067630 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9b014ddc0 0x7fc9b014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9b0155720 0x7fc9b0155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 --2- 172.21.15.42:0/418374749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9980039d0 0x7fc9b013b290 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.207+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 >> 172.21.15.42:0/418374749 conn(0x7fc9b0066e60 msgr2=0x7fc9b00acd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.208+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 shutdown_connections 2024-08-17T02:30:32.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.208+0000 7fc9b7a00640 1 -- 172.21.15.42:0/418374749 wait complete. 2024-08-17T02:30:32.222 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:30:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.375+0000 7f53a1e00640 1 Processor -- start 2024-08-17T02:30:32.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.375+0000 7f53a1e00640 1 -- start start 2024-08-17T02:30:32.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f539c14c9e0 0x7f539c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f539c0cc3d0 0x7f539c0acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c0ad660 con 0x7f539c0ad220 2024-08-17T02:30:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c0696e0 con 0x7f539c14c9e0 2024-08-17T02:30:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c0699c0 con 0x7f539c0cc3d0 2024-08-17T02:30:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a0a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f539c14c9e0 0x7f539c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f539c0ad220 0x7f539c156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38528/0 (socket says 172.21.15.42:38528) 2024-08-17T02:30:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a1400640 1 -- 172.21.15.42:0/3579018839 learned_addr learned my addr 172.21.15.42:0/3579018839 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:32.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f539be00640 1 --2- 172.21.15.42:0/3579018839 >> v2:172.21.15.62:3300/0 conn(0x7f539c0cc3d0 0x7f539c0acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a0a00640 1 -- 172.21.15.42:0/3579018839 >> v2:172.21.15.62:3300/0 conn(0x7f539c0cc3d0 msgr2=0x7f539c0acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a0a00640 1 --2- 172.21.15.42:0/3579018839 >> v2:172.21.15.62:3300/0 conn(0x7f539c0cc3d0 0x7f539c0acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.377+0000 7f53a0a00640 1 -- 172.21.15.42:0/3579018839 >> v1:172.21.15.42:6789/0 conn(0x7f539c0ad220 legacy=0x7f539c156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.378+0000 7f53a0a00640 1 -- 172.21.15.42:0/3579018839 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c069ca0 con 0x7f539c14c9e0 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.378+0000 7f539b400640 1 -- 172.21.15.42:0/3579018839 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130392696 0 0) 0x7f539c0ad660 con 0x7f539c0ad220 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a0a00640 1 --2- 172.21.15.42:0/3579018839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c14c9e0 0x7f539c0cbe90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f539c069460 tx=0x7f53900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8d7a95d2a40480 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f539b400640 1 -- 172.21.15.42:0/3579018839 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539002adb0 con 0x7f539c14c9e0 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f539b400640 1 -- 172.21.15.42:0/3579018839 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5390032440 con 0x7f539c14c9e0 2024-08-17T02:30:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f539b400640 1 -- 172.21.15.42:0/3579018839 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900327e0 con 0x7f539c14c9e0 2024-08-17T02:30:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a1e00640 1 -- 172.21.15.42:0/3579018839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c14c9e0 msgr2=0x7f539c0cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a1e00640 1 --2- 172.21.15.42:0/3579018839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c14c9e0 0x7f539c0cbe90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f539c069460 tx=0x7f53900090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a1e00640 1 -- 172.21.15.42:0/3579018839 shutdown_connections 2024-08-17T02:30:32.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a1e00640 1 --2- 172.21.15.42:0/3579018839 >> v2:172.21.15.62:3300/0 conn(0x7f539c0cc3d0 0x7f539c0acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a1e00640 1 --2- 172.21.15.42:0/3579018839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c14c9e0 0x7f539c0cbe90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.379+0000 7f53a1e00640 1 -- 172.21.15.42:0/3579018839 >> 172.21.15.42:0/3579018839 conn(0x7f539c067930 msgr2=0x7f539c0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.380+0000 7f53a1e00640 1 -- 172.21.15.42:0/3579018839 shutdown_connections 2024-08-17T02:30:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.380+0000 7f53a1e00640 1 -- 172.21.15.42:0/3579018839 wait complete. 2024-08-17T02:30:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.381+0000 7f53a1e00640 1 Processor -- start 2024-08-17T02:30:32.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.381+0000 7f53a1e00640 1 -- start start 2024-08-17T02:30:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f539c0ad220 0x7f539c0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 0x7f539c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c14c9e0 0x7f539c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c152b10 con 0x7f539c0cc3d0 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0c7390 con 0x7f539c14c9e0 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0c5260 con 0x7f539c0ad220 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f539be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 0x7f539c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f539be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 0x7f539c157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55458/0 (socket says 172.21.15.42:55458) 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f539be00640 1 -- 172.21.15.42:0/920487802 learned_addr learned my addr 172.21.15.42:0/920487802 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a0a00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f539c0ad220 0x7f539c0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.382+0000 7f53a1400640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c14c9e0 0x7f539c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f539be00640 1 -- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f539c0ad220 msgr2=0x7f539c0c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f539be00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f539c0ad220 0x7f539c0c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f539be00640 1 -- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c14c9e0 msgr2=0x7f539c14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f539be00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c14c9e0 0x7f539c14ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f539be00640 1 -- 172.21.15.42:0/920487802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390009390 con 0x7f539c0cc3d0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f53a1400640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c14c9e0 0x7f539c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f539be00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 0x7f539c157880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f538800ea20 tx=0x7f53880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800ca10 con 0x7f539c0cc3d0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800cb70 con 0x7f539c0cc3d0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388013470 con 0x7f539c0cc3d0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c0c5540 con 0x7f539c0cc3d0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.383+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c0c5b00 con 0x7f539c0cc3d0 2024-08-17T02:30:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.384+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c152c80 con 0x7f539c0cc3d0 2024-08-17T02:30:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.385+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5388013860 con 0x7f539c0cc3d0 2024-08-17T02:30:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.386+0000 7f538fe00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f537c065150 0x7f537c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.386+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f5388082b50 con 0x7f539c0cc3d0 2024-08-17T02:30:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.386+0000 7f53a0a00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f537c065150 0x7f537c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.387+0000 7f53a0a00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f537c065150 0x7f537c067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5390034000 tx=0x7f5390032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.390+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53880508a0 con 0x7f539c0cc3d0 2024-08-17T02:30:32.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.571+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f539c070720 con 0x7f539c0cc3d0 2024-08-17T02:30:32.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.571+0000 7f538fe00640 1 -- 172.21.15.42:0/920487802 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f53880170a0 con 0x7f539c0cc3d0 2024-08-17T02:30:32.571 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-08-17T02:30:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f537c065150 msgr2=0x7f537c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f537c065150 0x7f537c067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5390034000 tx=0x7f5390032000 comp rx=0 tx=0).stop 2024-08-17T02:30:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 msgr2=0x7f539c157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 0x7f539c157880 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f538800ea20 tx=0x7f53880090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 shutdown_connections 2024-08-17T02:30:32.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f537c065150 0x7f537c067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f539c14c9e0 0x7f539c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f539c0cc3d0 0x7f539c157880 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 --2- 172.21.15.42:0/920487802 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f539c0ad220 0x7f539c0c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.573+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 >> 172.21.15.42:0/920487802 conn(0x7f539c067930 msgr2=0x7f539c0c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.574+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 shutdown_connections 2024-08-17T02:30:32.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.574+0000 7f53a1e00640 1 -- 172.21.15.42:0/920487802 wait complete. 2024-08-17T02:30:32.588 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039443.meta pg_num 2024-08-17T02:30:32.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.742+0000 7faa23200640 1 Processor -- start 2024-08-17T02:30:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.742+0000 7faa23200640 1 -- start start 2024-08-17T02:30:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.743+0000 7faa23200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa1c1590b0 0x7faa1c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.743+0000 7faa23200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0c92b0 con 0x7faa1c0acf10 2024-08-17T02:30:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.743+0000 7faa23200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0ad480 con 0x7faa1c0afca0 2024-08-17T02:30:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.743+0000 7faa23200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0b0980 con 0x7faa1c1590b0 2024-08-17T02:30:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa1b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faa1c1590b0 0x7faa1c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa21200640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7faa1c0acf10 0x7faa1c0c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38538/0 (socket says 172.21.15.42:38538) 2024-08-17T02:30:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa1be00640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa1c0afca0 0x7faa1c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:42554/0 (socket says 172.21.15.42:42554) 2024-08-17T02:30:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa21200640 1 -- 172.21.15.42:0/2573613545 learned_addr learned my addr 172.21.15.42:0/2573613545 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa1b400640 1 -- 172.21.15.42:0/2573613545 >> v1:172.21.15.62:6789/0 conn(0x7faa1c0afca0 legacy=0x7faa1c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa1b400640 1 -- 172.21.15.42:0/2573613545 >> v1:172.21.15.42:6789/0 conn(0x7faa1c0acf10 legacy=0x7faa1c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.744+0000 7faa1b400640 1 -- 172.21.15.42:0/2573613545 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c0ad760 con 0x7faa1c1590b0 2024-08-17T02:30:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.745+0000 7faa1b400640 1 --2- 172.21.15.42:0/2573613545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c1590b0 0x7faa1c0b0070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faa08009850 tx=0x7faa080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324686521f1f8092 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.745+0000 7faa1aa00640 1 -- 172.21.15.42:0/2573613545 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0802ae20 con 0x7faa1c1590b0 2024-08-17T02:30:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.745+0000 7faa1aa00640 1 -- 172.21.15.42:0/2573613545 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa08032440 con 0x7faa1c1590b0 2024-08-17T02:30:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.745+0000 7faa1aa00640 1 -- 172.21.15.42:0/2573613545 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08032820 con 0x7faa1c1590b0 2024-08-17T02:30:32.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 -- 172.21.15.42:0/2573613545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c1590b0 msgr2=0x7faa1c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 --2- 172.21.15.42:0/2573613545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c1590b0 0x7faa1c0b0070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faa08009850 tx=0x7faa080090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 -- 172.21.15.42:0/2573613545 shutdown_connections 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 --2- 172.21.15.42:0/2573613545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c1590b0 0x7faa1c0b0070 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 -- 172.21.15.42:0/2573613545 >> 172.21.15.42:0/2573613545 conn(0x7faa1c066e60 msgr2=0x7faa1c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 -- 172.21.15.42:0/2573613545 shutdown_connections 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.746+0000 7faa23200640 1 -- 172.21.15.42:0/2573613545 wait complete. 2024-08-17T02:30:32.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.747+0000 7faa23200640 1 Processor -- start 2024-08-17T02:30:32.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.748+0000 7faa23200640 1 -- start start 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.748+0000 7faa23200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 0x7faa1c0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.748+0000 7faa23200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa1c0afca0 0x7faa1c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.748+0000 7faa23200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa1c1590b0 0x7faa1c14b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa23200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0c79c0 con 0x7faa1c0acf10 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa23200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c140a40 con 0x7faa1c1590b0 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa23200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0c54c0 con 0x7faa1c0afca0 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 0x7faa1c0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 0x7faa1c0c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55480/0 (socket says 172.21.15.42:55480) 2024-08-17T02:30:32.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 -- 172.21.15.42:0/3357736930 learned_addr learned my addr 172.21.15.42:0/3357736930 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 -- 172.21.15.42:0/3357736930 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa1c0afca0 msgr2=0x7faa1c140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa1c0afca0 0x7faa1c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 -- 172.21.15.42:0/3357736930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa1c1590b0 msgr2=0x7faa1c14b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa1c1590b0 0x7faa1c14b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 -- 172.21.15.42:0/3357736930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa08009390 con 0x7faa1c0acf10 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.749+0000 7faa1be00640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 0x7faa1c0c7480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c590 tx=0x7faa0c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.750+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c007300 con 0x7faa1c0acf10 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.750+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c0074a0 con 0x7faa1c0acf10 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.750+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0047a0 con 0x7faa1c0acf10 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.750+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c0c48b0 con 0x7faa1c0acf10 2024-08-17T02:30:32.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.750+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c0c4e70 con 0x7faa1c0acf10 2024-08-17T02:30:32.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.751+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c067b70 con 0x7faa1c0acf10 2024-08-17T02:30:32.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.751+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faa0c004bd0 con 0x7faa1c0acf10 2024-08-17T02:30:32.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.752+0000 7faa13400640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9fc065150 0x7fa9fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:32.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.752+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7faa0c081730 con 0x7faa1c0acf10 2024-08-17T02:30:32.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.753+0000 7faa1b400640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9fc065150 0x7fa9fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:32.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.753+0000 7faa1b400640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9fc065150 0x7fa9fc067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faa08034000 tx=0x7faa08032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:32.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.756+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faa0c04be40 con 0x7faa1c0acf10 2024-08-17T02:30:32.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.937+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.meta", "var": "pg_num"} v 0) v1 -- 0x7faa1c063f90 con 0x7faa1c0acf10 2024-08-17T02:30:32.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.938+0000 7faa13400640 1 -- 172.21.15.42:0/3357736930 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7faa0c04f500 con 0x7faa1c0acf10 2024-08-17T02:30:32.938 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:30:32.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9fc065150 msgr2=0x7fa9fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9fc065150 0x7fa9fc067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faa08034000 tx=0x7faa08032000 comp rx=0 tx=0).stop 2024-08-17T02:30:32.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 msgr2=0x7faa1c0c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:32.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 0x7faa1c0c7480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c590 tx=0x7faa0c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 shutdown_connections 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa9fc065150 0x7fa9fc067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa1c1590b0 0x7faa1c14b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa1c0afca0 0x7faa1c140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 --2- 172.21.15.42:0/3357736930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa1c0acf10 0x7faa1c0c7480 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 >> 172.21.15.42:0/3357736930 conn(0x7faa1c066e60 msgr2=0x7faa1c0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 shutdown_connections 2024-08-17T02:30:32.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:32.940+0000 7faa23200640 1 -- 172.21.15.42:0/3357736930 wait complete. 2024-08-17T02:30:32.955 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039443.data pg_num 2024-08-17T02:30:33.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.110+0000 7fc5ae200640 1 Processor -- start 2024-08-17T02:30:33.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.110+0000 7fc5ae200640 1 -- start start 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.111+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80ca050 0x7fc5a8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.111+0000 7fc5ae200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80cb160 con 0x7fc5a80add30 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.111+0000 7fc5ae200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80b0d10 con 0x7fc5a80ad960 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.111+0000 7fc5ae200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80ca550 con 0x7fc5a80ca050 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc5a7e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc5a80add30 0x7fc5a80aec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38542/0 (socket says 172.21.15.42:38542) 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc5a7e00640 1 -- 172.21.15.42:0/2065470615 learned_addr learned my addr 172.21.15.42:0/2065470615 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc59fe00640 1 --2- 172.21.15.42:0/2065470615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80ca050 0x7fc5a8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264033245 0 0) 0x7fc5a80b0d10 con 0x7fc5a80ad960 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc58c0034e0 con 0x7fc5a80ad960 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208230443 0 0) 0x7fc5a80cb160 con 0x7fc5a80add30 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a80b0d10 con 0x7fc5a80add30 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc59fe00640 1 -- 172.21.15.42:0/2065470615 >> v1:172.21.15.62:6789/0 conn(0x7fc5a80ad960 legacy=0x7fc5a8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc59fe00640 1 -- 172.21.15.42:0/2065470615 >> v1:172.21.15.42:6789/0 conn(0x7fc5a80add30 legacy=0x7fc5a80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.112+0000 7fc59fe00640 1 -- 172.21.15.42:0/2065470615 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80ca830 con 0x7fc5a80ca050 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.113+0000 7fc59fe00640 1 --2- 172.21.15.42:0/2065470615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80ca050 0x7fc5a8156b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc590009880 tx=0x7fc5900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9233b67e3957dd94 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59002aea0 con 0x7fc5a80ca050 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590032440 con 0x7fc5a80ca050 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5a6a00640 1 -- 172.21.15.42:0/2065470615 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900327c0 con 0x7fc5a80ca050 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 -- 172.21.15.42:0/2065470615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80ca050 msgr2=0x7fc5a8156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 --2- 172.21.15.42:0/2065470615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80ca050 0x7fc5a8156b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc590009880 tx=0x7fc5900090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 -- 172.21.15.42:0/2065470615 shutdown_connections 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 --2- 172.21.15.42:0/2065470615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80ca050 0x7fc5a8156b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 -- 172.21.15.42:0/2065470615 >> 172.21.15.42:0/2065470615 conn(0x7fc5a8066e60 msgr2=0x7fc5a8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 -- 172.21.15.42:0/2065470615 shutdown_connections 2024-08-17T02:30:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.114+0000 7fc5ae200640 1 -- 172.21.15.42:0/2065470615 wait complete. 2024-08-17T02:30:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.116+0000 7fc5ae200640 1 Processor -- start 2024-08-17T02:30:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.116+0000 7fc5ae200640 1 -- start start 2024-08-17T02:30:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 0x7fc5a81453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80add30 0x7fc5a80aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a80ca050 0x7fc5a806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5ae200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80a8a10 con 0x7fc5a80ad960 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5ae200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a81458e0 con 0x7fc5a80ca050 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5ae200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80a8cb0 con 0x7fc5a80add30 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 0x7fc5a81453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 0x7fc5a81453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55482/0 (socket says 172.21.15.42:55482) 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 -- 172.21.15.42:0/43460315 learned_addr learned my addr 172.21.15.42:0/43460315 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7e00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a80ca050 0x7fc5a806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 -- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80add30 msgr2=0x7fc5a80aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc59fe00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80add30 0x7fc5a80aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80add30 0x7fc5a80aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 -- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a80ca050 msgr2=0x7fc5a806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a80ca050 0x7fc5a806ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7400640 1 -- 172.21.15.42:0/43460315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc590009390 con 0x7fc5a80ad960 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc5a7e00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a80ca050 0x7fc5a806ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:33.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.117+0000 7fc59fe00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80add30 0x7fc5a80aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.118+0000 7fc5a7400640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 0x7fc5a81453a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c560 tx=0x7fc598007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.118+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598011590 con 0x7fc5a80ad960 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.118+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5980116f0 con 0x7fc5a80ad960 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.118+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598011ab0 con 0x7fc5a80ad960 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.118+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a80a8f90 con 0x7fc5a80ad960 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.118+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a80a9550 con 0x7fc5a80ad960 2024-08-17T02:30:33.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.119+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a80a9740 con 0x7fc5a80ad960 2024-08-17T02:30:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.120+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc59801c460 con 0x7fc5a80ad960 2024-08-17T02:30:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.121+0000 7fc59ea00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc584065150 0x7fc584067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.121+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc598082520 con 0x7fc5a80ad960 2024-08-17T02:30:33.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.121+0000 7fc59fe00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc584065150 0x7fc584067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.122+0000 7fc59fe00640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc584065150 0x7fc584067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc590034000 tx=0x7fc590032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.125+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc5980501c0 con 0x7fc5a80ad960 2024-08-17T02:30:33.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.311+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.data", "var": "pg_num"} v 0) v1 -- 0x7fc5a8063fb0 con 0x7fc5a80ad960 2024-08-17T02:30:33.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.311+0000 7fc59ea00640 1 -- 172.21.15.42:0/43460315 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7fc5980537e0 con 0x7fc5a80ad960 2024-08-17T02:30:33.312 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:30:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.313+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc584065150 msgr2=0x7fc584067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.313+0000 7fc5ae200640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc584065150 0x7fc584067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc590034000 tx=0x7fc590032000 comp rx=0 tx=0).stop 2024-08-17T02:30:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.313+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 msgr2=0x7fc5a81453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.313+0000 7fc5ae200640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 0x7fc5a81453a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c560 tx=0x7fc598007d60 comp rx=0 tx=0).stop 2024-08-17T02:30:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 shutdown_connections 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc584065150 0x7fc584067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5a80ca050 0x7fc5a806ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc5a80add30 0x7fc5a80aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 --2- 172.21.15.42:0/43460315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc5a80ad960 0x7fc5a81453a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 >> 172.21.15.42:0/43460315 conn(0x7fc5a8066e60 msgr2=0x7fc5a8154830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 shutdown_connections 2024-08-17T02:30:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.314+0000 7fc5ae200640 1 -- 172.21.15.42:0/43460315 wait complete. 2024-08-17T02:30:33.329 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:33.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.482+0000 7f331e800640 1 Processor -- start 2024-08-17T02:30:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.482+0000 7f331e800640 1 -- start start 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.484+0000 7f331e800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f331815c2d0 0x7f33180ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.484+0000 7f331e800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33180c70d0 con 0x7f33180ca410 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.484+0000 7f331e800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33180c6da0 con 0x7f33180cc7f0 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.484+0000 7f331e800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180ca890 con 0x7f331815c2d0 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331de00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f33180ca410 0x7f33180c7560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38546/0 (socket says 172.21.15.42:38546) 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331de00640 1 -- 172.21.15.42:0/4120230261 learned_addr learned my addr 172.21.15.42:0/4120230261 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331d400640 1 --1- 172.21.15.42:0/4120230261 >> v1:172.21.15.62:6789/0 conn(0x7f33180cc7f0 0x7f331815bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:42568/0 (socket says 172.21.15.42:42568) 2024-08-17T02:30:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331ca00640 1 --2- 172.21.15.42:0/4120230261 >> v2:172.21.15.42:3300/0 conn(0x7f331815c2d0 0x7f33180ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f3317e00640 1 -- 172.21.15.42:0/4120230261 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250993846 0 0) 0x7f33180c70d0 con 0x7f33180ca410 2024-08-17T02:30:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f3317e00640 1 -- 172.21.15.42:0/4120230261 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33000034e0 con 0x7f33180ca410 2024-08-17T02:30:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f3317e00640 1 -- 172.21.15.42:0/4120230261 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636229885 0 0) 0x7f33180c6da0 con 0x7f33180cc7f0 2024-08-17T02:30:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331ca00640 1 -- 172.21.15.42:0/4120230261 >> v1:172.21.15.62:6789/0 conn(0x7f33180cc7f0 legacy=0x7f331815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331ca00640 1 -- 172.21.15.42:0/4120230261 >> v1:172.21.15.42:6789/0 conn(0x7f33180ca410 legacy=0x7f33180c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.485+0000 7f331ca00640 1 -- 172.21.15.42:0/4120230261 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180caaa0 con 0x7f331815c2d0 2024-08-17T02:30:33.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.486+0000 7f331ca00640 1 --2- 172.21.15.42:0/4120230261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f331815c2d0 0x7f33180ccbc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3304009850 tx=0x7f33040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eea540df8d77f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.486+0000 7f3317e00640 1 -- 172.21.15.42:0/4120230261 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330402ad00 con 0x7f331815c2d0 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.486+0000 7f3317e00640 1 -- 172.21.15.42:0/4120230261 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330402ae60 con 0x7f331815c2d0 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.486+0000 7f3317e00640 1 -- 172.21.15.42:0/4120230261 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304032670 con 0x7f331815c2d0 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 -- 172.21.15.42:0/4120230261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f331815c2d0 msgr2=0x7f33180ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 --2- 172.21.15.42:0/4120230261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f331815c2d0 0x7f33180ccbc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3304009850 tx=0x7f33040090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 -- 172.21.15.42:0/4120230261 shutdown_connections 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 --2- 172.21.15.42:0/4120230261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f331815c2d0 0x7f33180ccbc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 -- 172.21.15.42:0/4120230261 >> 172.21.15.42:0/4120230261 conn(0x7f3318087a80 msgr2=0x7f331806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 -- 172.21.15.42:0/4120230261 shutdown_connections 2024-08-17T02:30:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.487+0000 7f331e800640 1 -- 172.21.15.42:0/4120230261 wait complete. 2024-08-17T02:30:33.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 Processor -- start 2024-08-17T02:30:33.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 -- start start 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 0x7f3318146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33180cc7f0 0x7f33180b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f331815c2d0 0x7f33180b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180b5210 con 0x7f33180ca410 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.489+0000 7f331e800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180b4330 con 0x7f331815c2d0 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331e800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180b4600 con 0x7f33180cc7f0 2024-08-17T02:30:33.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 0x7f3318146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 0x7f3318146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55506/0 (socket says 172.21.15.42:55506) 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 -- 172.21.15.42:0/1842990997 learned_addr learned my addr 172.21.15.42:0/1842990997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331ca00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33180cc7f0 0x7f33180b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331de00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f331815c2d0 0x7f33180b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 -- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33180cc7f0 msgr2=0x7f33180b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33180cc7f0 0x7f33180b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 -- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f331815c2d0 msgr2=0x7f33180b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f331815c2d0 0x7f33180b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 -- 172.21.15.42:0/1842990997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304009390 con 0x7f33180ca410 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331ca00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33180cc7f0 0x7f33180b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331de00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f331815c2d0 0x7f33180b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.490+0000 7f331d400640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 0x7f3318146fb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f330c00c5e0 tx=0x7f330c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.491+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c007300 con 0x7f33180ca410 2024-08-17T02:30:33.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.491+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c007480 con 0x7f33180ca410 2024-08-17T02:30:33.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.491+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33180b48e0 con 0x7f33180ca410 2024-08-17T02:30:33.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.491+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0049f0 con 0x7f33180ca410 2024-08-17T02:30:33.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.491+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33180b4ea0 con 0x7f33180ca410 2024-08-17T02:30:33.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.492+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3318070720 con 0x7f33180ca410 2024-08-17T02:30:33.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.493+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f330c01c3b0 con 0x7f33180ca410 2024-08-17T02:30:33.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.493+0000 7f3314c00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f8065150 0x7f32f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.493+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f330c081c20 con 0x7f33180ca410 2024-08-17T02:30:33.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.494+0000 7f331ca00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f8065150 0x7f32f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.494+0000 7f331ca00640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f8065150 0x7f32f8067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3304034000 tx=0x7f3304032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.497+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f330c04fa00 con 0x7f33180ca410 2024-08-17T02:30:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.716+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33180c4960 con 0x7f33180ca410 2024-08-17T02:30:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.717+0000 7f3314c00640 1 -- 172.21.15.42:0/1842990997 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f330c018090 con 0x7f33180ca410 2024-08-17T02:30:33.717 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:33.718 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:15.308187+0000","modified":"2024-08-17T02:28:18.906436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4887},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4887":{"gid":4887,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6836/3869657839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3869657839},{"type":"v1","addr":"172.21.15.42:6836","nonce":3869657839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 19 2024-08-17T02:30:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f8065150 msgr2=0x7f32f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f8065150 0x7f32f8067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3304034000 tx=0x7f3304032000 comp rx=0 tx=0).stop 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 msgr2=0x7f3318146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 0x7f3318146fb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f330c00c5e0 tx=0x7f330c007d00 comp rx=0 tx=0).stop 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 shutdown_connections 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f8065150 0x7f32f8067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f331815c2d0 0x7f33180b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33180cc7f0 0x7f33180b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 --2- 172.21.15.42:0/1842990997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33180ca410 0x7f3318146fb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 >> 172.21.15.42:0/1842990997 conn(0x7f3318087a80 msgr2=0x7f33180c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 shutdown_connections 2024-08-17T02:30:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.719+0000 7f331e800640 1 -- 172.21.15.42:0/1842990997 wait complete. 2024-08-17T02:30:33.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.886+0000 7fb4f7000640 1 Processor -- start 2024-08-17T02:30:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.886+0000 7fb4f7000640 1 -- start start 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.887+0000 7fb4f7000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb4f00ad960 0x7fb4f015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.887+0000 7fb4f7000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4f00ca050 0x7fb4f0156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.887+0000 7fb4f7000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f015b5e0 con 0x7fb4f00add30 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.887+0000 7fb4f7000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00cb160 con 0x7fb4f00ad960 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.887+0000 7fb4f7000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00b0d10 con 0x7fb4f00ca050 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb4f00ad960 0x7fb4f015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb4f00ad960 0x7fb4f015b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55516/0 (socket says 172.21.15.42:55516) 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 -- 172.21.15.42:0/1469010991 learned_addr learned my addr 172.21.15.42:0/1469010991 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4ef400640 1 --2- 172.21.15.42:0/1469010991 >> v2:172.21.15.62:3300/0 conn(0x7fb4f00ca050 0x7fb4f0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 -- 172.21.15.42:0/1469010991 >> v2:172.21.15.62:3300/0 conn(0x7fb4f00ca050 msgr2=0x7fb4f0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 --2- 172.21.15.42:0/1469010991 >> v2:172.21.15.62:3300/0 conn(0x7fb4f00ca050 0x7fb4f0156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 -- 172.21.15.42:0/1469010991 >> v1:172.21.15.62:6789/0 conn(0x7fb4f00add30 legacy=0x7fb4f0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.888+0000 7fb4efe00640 1 -- 172.21.15.42:0/1469010991 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00ca550 con 0x7fb4f00ad960 2024-08-17T02:30:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.889+0000 7fb4efe00640 1 --2- 172.21.15.42:0/1469010991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f015b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0063600 tx=0x7fb4e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd53a6e728eefb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.889+0000 7fb4eea00640 1 -- 172.21.15.42:0/1469010991 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0032440 con 0x7fb4f00ad960 2024-08-17T02:30:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.889+0000 7fb4eea00640 1 -- 172.21.15.42:0/1469010991 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00325a0 con 0x7fb4f00ad960 2024-08-17T02:30:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.889+0000 7fb4eea00640 1 -- 172.21.15.42:0/1469010991 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0032980 con 0x7fb4f00ad960 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 -- 172.21.15.42:0/1469010991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 msgr2=0x7fb4f015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1469010991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f015b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0063600 tx=0x7fb4e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 -- 172.21.15.42:0/1469010991 shutdown_connections 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1469010991 >> v2:172.21.15.62:3300/0 conn(0x7fb4f00ca050 0x7fb4f0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1469010991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f015b0a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 -- 172.21.15.42:0/1469010991 >> 172.21.15.42:0/1469010991 conn(0x7fb4f0066e60 msgr2=0x7fb4f0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 -- 172.21.15.42:0/1469010991 shutdown_connections 2024-08-17T02:30:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.890+0000 7fb4f7000640 1 -- 172.21.15.42:0/1469010991 wait complete. 2024-08-17T02:30:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.891+0000 7fb4f7000640 1 Processor -- start 2024-08-17T02:30:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 -- start start 2024-08-17T02:30:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f0166c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f00add30 0x7fb4f00a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00ca050 0x7fb4f00a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0159030 con 0x7fb4f00ad960 2024-08-17T02:30:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0159310 con 0x7fb4f00add30 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.892+0000 7fb4f7000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01595f0 con 0x7fb4f00ca050 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f0166c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f0166c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55524/0 (socket says 172.21.15.42:55524) 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 -- 172.21.15.42:0/1302549410 learned_addr learned my addr 172.21.15.42:0/1302549410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4ef400640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f00add30 0x7fb4f00a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4f5000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00ca050 0x7fb4f00a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 -- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00ca050 msgr2=0x7fb4f00a7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00ca050 0x7fb4f00a7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 -- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f00add30 msgr2=0x7fb4f00a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f00add30 0x7fb4f00a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 -- 172.21.15.42:0/1302549410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009450 con 0x7fb4f00ad960 2024-08-17T02:30:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4efe00640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f0166c90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0035040 tx=0x7fb4e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.893+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0031bb0 con 0x7fb4f00ad960 2024-08-17T02:30:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.894+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e0031d30 con 0x7fb4f00ad960 2024-08-17T02:30:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.894+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e003d670 con 0x7fb4f00ad960 2024-08-17T02:30:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.894+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f01598d0 con 0x7fb4f00ad960 2024-08-17T02:30:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.894+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f01671d0 con 0x7fb4f00ad960 2024-08-17T02:30:33.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.895+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0063fb0 con 0x7fb4f00ad960 2024-08-17T02:30:33.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.896+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb4e0039040 con 0x7fb4f00ad960 2024-08-17T02:30:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.896+0000 7fb4e7400640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.896+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb4e00a2680 con 0x7fb4f00ad960 2024-08-17T02:30:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.897+0000 7fb4ef400640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:33.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.897+0000 7fb4ef400640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb4f006e4a0 tx=0x7fb4dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:33.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:33.901+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb4e0070320 con 0x7fb4f00ad960 2024-08-17T02:30:34.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.085+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4f00ab220 con 0x7fb4f00ad960 2024-08-17T02:30:34.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.086+0000 7fb4e7400640 1 -- 172.21.15.42:0/1302549410 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7fb4e0073940 con 0x7fb4f00ad960 2024-08-17T02:30:34.086 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:34.086 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:31.012089+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:34.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 msgr2=0x7fb4d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb4f006e4a0 tx=0x7fb4dc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 msgr2=0x7fb4f0166c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f0166c90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0035040 tx=0x7fb4e0032000 comp rx=0 tx=0).stop 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 shutdown_connections 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb4d0065150 0x7fb4d0067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4f00ca050 0x7fb4f00a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4f00add30 0x7fb4f00a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 --2- 172.21.15.42:0/1302549410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4f00ad960 0x7fb4f0166c90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 >> 172.21.15.42:0/1302549410 conn(0x7fb4f0066e60 msgr2=0x7fb4f0154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 shutdown_connections 2024-08-17T02:30:34.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.088+0000 7fb4f7000640 1 -- 172.21.15.42:0/1302549410 wait complete. 2024-08-17T02:30:34.104 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:30:34.104 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.255+0000 7f342f200640 1 Processor -- start 2024-08-17T02:30:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.255+0000 7f342f200640 1 -- start start 2024-08-17T02:30:34.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342f200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34300b0e30 0x7f34300b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342f200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3430156f90 0x7f34300cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342f200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343006d7c0 con 0x7f343015a590 2024-08-17T02:30:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342f200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34300cb5b0 con 0x7f34300b0e30 2024-08-17T02:30:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342f200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343015ab30 con 0x7f3430156f90 2024-08-17T02:30:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342e800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f343015a590 0x7f343013fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:42588/0 (socket says 172.21.15.42:42588) 2024-08-17T02:30:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342e800640 1 -- 172.21.15.42:0/3451254469 learned_addr learned my addr 172.21.15.42:0/3451254469 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.256+0000 7f342de00640 1 --2- 172.21.15.42:0/3451254469 >> v2:172.21.15.62:3300/0 conn(0x7f34300b0e30 0x7f34300b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f3427e00640 1 --2- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3430156f90 0x7f34300cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f342d400640 1 -- 172.21.15.42:0/3451254469 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669765440 0 0) 0x7f343006d7c0 con 0x7f343015a590 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f342d400640 1 -- 172.21.15.42:0/3451254469 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34140034e0 con 0x7f343015a590 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f342de00640 1 -- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3430156f90 msgr2=0x7f34300cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f342de00640 1 --2- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3430156f90 0x7f34300cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f342de00640 1 -- 172.21.15.42:0/3451254469 >> v1:172.21.15.62:6789/0 conn(0x7f343015a590 legacy=0x7f343013fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.257+0000 7f342de00640 1 -- 172.21.15.42:0/3451254469 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343015ae10 con 0x7f34300b0e30 2024-08-17T02:30:34.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.258+0000 7f342de00640 1 --2- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34300b0e30 0x7f34300b1200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3420009850 tx=0x7f34200090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa1b4431bfcb1f23 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342d400640 1 -- 172.21.15.42:0/3451254469 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342002ad90 con 0x7f34300b0e30 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342d400640 1 -- 172.21.15.42:0/3451254469 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420032440 con 0x7f34300b0e30 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342d400640 1 -- 172.21.15.42:0/3451254469 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420032820 con 0x7f34300b0e30 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 -- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34300b0e30 msgr2=0x7f34300b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 --2- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34300b0e30 0x7f34300b1200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3420009850 tx=0x7f34200090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 -- 172.21.15.42:0/3451254469 shutdown_connections 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 --2- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3430156f90 0x7f34300cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 --2- 172.21.15.42:0/3451254469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34300b0e30 0x7f34300b1200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 -- 172.21.15.42:0/3451254469 >> 172.21.15.42:0/3451254469 conn(0x7f3430062af0 msgr2=0x7f3430062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 -- 172.21.15.42:0/3451254469 shutdown_connections 2024-08-17T02:30:34.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.259+0000 7f342f200640 1 -- 172.21.15.42:0/3451254469 wait complete. 2024-08-17T02:30:34.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.261+0000 7f342f200640 1 Processor -- start 2024-08-17T02:30:34.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.261+0000 7f342f200640 1 -- start start 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342f200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34300b0e30 0x7f343015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 0x7f343014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342f200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f343015a590 0x7f3430158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343015be20 con 0x7f3430156f90 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342f200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343015c100 con 0x7f343015a590 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342f200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343015c3e0 con 0x7f34300b0e30 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 0x7f343014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 0x7f343014dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55528/0 (socket says 172.21.15.42:55528) 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 -- 172.21.15.42:0/1485443405 learned_addr learned my addr 172.21.15.42:0/1485443405 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342e800640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f343015a590 0x7f3430158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f342de00640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34300b0e30 0x7f343015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 -- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34300b0e30 msgr2=0x7f343015b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34300b0e30 0x7f343015b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 -- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f343015a590 msgr2=0x7f3430158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f343015a590 0x7f3430158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.262+0000 7f3427e00640 1 -- 172.21.15.42:0/1485443405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009390 con 0x7f3430156f90 2024-08-17T02:30:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.263+0000 7f3427e00640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 0x7f343014dda0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f341800ea20 tx=0x7f34180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.263+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341800ca10 con 0x7f3430156f90 2024-08-17T02:30:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.263+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341800cb70 con 0x7f3430156f90 2024-08-17T02:30:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.263+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343015c6c0 con 0x7f3430156f90 2024-08-17T02:30:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.263+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418013470 con 0x7f3430156f90 2024-08-17T02:30:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.263+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343015bb10 con 0x7f3430156f90 2024-08-17T02:30:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.264+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343006a470 con 0x7f3430156f90 2024-08-17T02:30:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.265+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3418013860 con 0x7f3430156f90 2024-08-17T02:30:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.266+0000 7f3425600640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f340c065150 0x7f340c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.266+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3418082ab0 con 0x7f3430156f90 2024-08-17T02:30:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.266+0000 7f342de00640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f340c065150 0x7f340c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.267+0000 7f342de00640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f340c065150 0x7f340c067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3420034000 tx=0x7f3420032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.270+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3418050800 con 0x7f3430156f90 2024-08-17T02:30:34.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.490+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f343013bd20 con 0x7f3430156f90 2024-08-17T02:30:34.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.490+0000 7f3425600640 1 -- 172.21.15.42:0/1485443405 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f3418053e20 con 0x7f3430156f90 2024-08-17T02:30:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:34.491 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:15.308187+0000","modified":"2024-08-17T02:28:18.906436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4887},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4887":{"gid":4887,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6836/3869657839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3869657839},{"type":"v1","addr":"172.21.15.42:6836","nonce":3869657839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:34.491 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 19 2024-08-17T02:30:34.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f340c065150 msgr2=0x7f340c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f340c065150 0x7f340c067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3420034000 tx=0x7f3420032000 comp rx=0 tx=0).stop 2024-08-17T02:30:34.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 msgr2=0x7f343014dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 0x7f343014dda0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f341800ea20 tx=0x7f34180090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 shutdown_connections 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f340c065150 0x7f340c067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f343015a590 0x7f3430158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3430156f90 0x7f343014dda0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 --2- 172.21.15.42:0/1485443405 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f34300b0e30 0x7f343015b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 >> 172.21.15.42:0/1485443405 conn(0x7f3430062af0 msgr2=0x7f34300afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 shutdown_connections 2024-08-17T02:30:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.493+0000 7f342f200640 1 -- 172.21.15.42:0/1485443405 wait complete. 2024-08-17T02:30:34.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.659+0000 7f65bf400640 1 Processor -- start 2024-08-17T02:30:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.659+0000 7f65bf400640 1 -- start start 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.660+0000 7f65bf400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.660+0000 7f65bf400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b80c92b0 con 0x7f65b80afca0 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.660+0000 7f65bf400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b80ad480 con 0x7f65b81590b0 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.660+0000 7f65bf400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80b0980 con 0x7f65b80acf10 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.660+0000 7f65bca00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f65b80afca0 0x7f65b81589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38552/0 (socket says 172.21.15.42:38552) 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65bca00640 1 -- 172.21.15.42:0/2344203344 learned_addr learned my addr 172.21.15.42:0/2344203344 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65bd400640 1 --2- 172.21.15.42:0/2344203344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269463738 0 0) 0x7f65b80c92b0 con 0x7f65b80afca0 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a00034e0 con 0x7f65b80afca0 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610073240 0 0) 0x7f65b80ad480 con 0x7f65b81590b0 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b80c92b0 con 0x7f65b81590b0 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65bd400640 1 -- 172.21.15.42:0/2344203344 >> v1:172.21.15.62:6789/0 conn(0x7f65b81590b0 legacy=0x7f65b80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65bd400640 1 -- 172.21.15.42:0/2344203344 >> v1:172.21.15.42:6789/0 conn(0x7f65b80afca0 legacy=0x7f65b81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.661+0000 7f65bd400640 1 -- 172.21.15.42:0/2344203344 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80ad760 con 0x7f65b80acf10 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.662+0000 7f65bd400640 1 --2- 172.21.15.42:0/2344203344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80b0070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009e90 tx=0x7f65b0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7ef677a4d2ab4d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0007550 con 0x7f65b80acf10 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b002d050 con 0x7f65b80acf10 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65b7400640 1 -- 172.21.15.42:0/2344203344 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00078e0 con 0x7f65b80acf10 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 -- 172.21.15.42:0/2344203344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 msgr2=0x7f65b80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 --2- 172.21.15.42:0/2344203344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80b0070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009e90 tx=0x7f65b0009780 comp rx=0 tx=0).stop 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 -- 172.21.15.42:0/2344203344 shutdown_connections 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 --2- 172.21.15.42:0/2344203344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80b0070 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 -- 172.21.15.42:0/2344203344 >> 172.21.15.42:0/2344203344 conn(0x7f65b8066e60 msgr2=0x7f65b8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 -- 172.21.15.42:0/2344203344 shutdown_connections 2024-08-17T02:30:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.663+0000 7f65bf400640 1 -- 172.21.15.42:0/2344203344 wait complete. 2024-08-17T02:30:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.665+0000 7f65bf400640 1 Processor -- start 2024-08-17T02:30:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.665+0000 7f65bf400640 1 -- start start 2024-08-17T02:30:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bf400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 0x7f65b813ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bf400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65b81590b0 0x7f65b80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bf400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80c2000 con 0x7f65b80afca0 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bf400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b81404d0 con 0x7f65b81590b0 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bf400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80c7240 con 0x7f65b80acf10 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 0x7f65b813ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 0x7f65b813ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55530/0 (socket says 172.21.15.42:55530) 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 -- 172.21.15.42:0/2527048892 learned_addr learned my addr 172.21.15.42:0/2527048892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bca00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65bd400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65b81590b0 0x7f65b80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 -- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 msgr2=0x7f65b80c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 -- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65b81590b0 msgr2=0x7f65b80c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65b81590b0 0x7f65b80c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.666+0000 7f65b7e00640 1 -- 172.21.15.42:0/2527048892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0009a20 con 0x7f65b80afca0 2024-08-17T02:30:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.667+0000 7f65b7e00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 0x7f65b813ff90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c510 tx=0x7f65a4007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.667+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4011590 con 0x7f65b80afca0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.667+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a40116f0 con 0x7f65b80afca0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.667+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4011ab0 con 0x7f65b80afca0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.667+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b80c74c0 con 0x7f65b80afca0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.667+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b80c1c90 con 0x7f65b80afca0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.668+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b80c21b0 con 0x7f65b80afca0 2024-08-17T02:30:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.669+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f65a401c460 con 0x7f65b80afca0 2024-08-17T02:30:34.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.670+0000 7f65abe00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6598065150 0x7f6598067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:34.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.670+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f65a40823d0 con 0x7f65b80afca0 2024-08-17T02:30:34.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.670+0000 7f65bca00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6598065150 0x7f6598067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:34.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.671+0000 7f65bca00640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6598065150 0x7f6598067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f65ac007fd0 tx=0x7f65ac007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:34.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.674+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65b80c21b0 con 0x7f65b80afca0 2024-08-17T02:30:34.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.895+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b80c21b0 con 0x7f65b80afca0 2024-08-17T02:30:34.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.895+0000 7f65abe00640 1 -- 172.21.15.42:0/2527048892 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5681 (secure 0 0 0) 0x7f65b80c21b0 con 0x7f65b80afca0 2024-08-17T02:30:34.896 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:34.896 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:15.308187+0000","modified":"2024-08-17T02:28:18.906436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4887},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4887":{"gid":4887,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6836/3869657839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3869657839},{"type":"v1","addr":"172.21.15.42:6836","nonce":3869657839}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:34.896 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 19 2024-08-17T02:30:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6598065150 msgr2=0x7f6598067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6598065150 0x7f6598067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f65ac007fd0 tx=0x7f65ac007d30 comp rx=0 tx=0).stop 2024-08-17T02:30:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 msgr2=0x7f65b813ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 0x7f65b813ff90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c510 tx=0x7f65a4007d50 comp rx=0 tx=0).stop 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 shutdown_connections 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6598065150 0x7f6598067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65b81590b0 0x7f65b80c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65b80afca0 0x7f65b813ff90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 --2- 172.21.15.42:0/2527048892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65b80acf10 0x7f65b80c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 >> 172.21.15.42:0/2527048892 conn(0x7f65b8066e60 msgr2=0x7f65b80caab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 shutdown_connections 2024-08-17T02:30:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:34.898+0000 7f65bf400640 1 -- 172.21.15.42:0/2527048892 wait complete. 2024-08-17T02:30:34.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:35.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.064+0000 7f73f7200640 1 Processor -- start 2024-08-17T02:30:35.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.064+0000 7f73f7200640 1 -- start start 2024-08-17T02:30:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.065+0000 7f73f7200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f73f80ca430 0x7f73f80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.065+0000 7f73f7200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80cb180 con 0x7f73f80ad790 2024-08-17T02:30:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.065+0000 7f73f7200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80af530 con 0x7f73f81552d0 2024-08-17T02:30:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.065+0000 7f73f7200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80ca8e0 con 0x7f73f80ca430 2024-08-17T02:30:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f5e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f73f80ad790 0x7f73f80c9d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38566/0 (socket says 172.21.15.42:38566) 2024-08-17T02:30:35.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f5e00640 1 -- 172.21.15.42:0/2813124944 learned_addr learned my addr 172.21.15.42:0/2813124944 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f5400640 1 --2- 172.21.15.42:0/2813124944 >> v2:172.21.15.62:3300/0 conn(0x7f73f80ca430 0x7f73f80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958694398 0 0) 0x7f73f80cb180 con 0x7f73f80ad790 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73dc0034e0 con 0x7f73f80ad790 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 609166628 0 0) 0x7f73dc0034e0 con 0x7f73f80ad790 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 >> v2:172.21.15.62:3300/0 conn(0x7f73f80ca430 msgr2=0x7f73f80adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f4a00640 1 --2- 172.21.15.42:0/2813124944 >> v2:172.21.15.62:3300/0 conn(0x7f73f80ca430 0x7f73f80adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.066+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 >> v1:172.21.15.62:6789/0 conn(0x7f73f81552d0 legacy=0x7f73f8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80cabc0 con 0x7f73f80ad790 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f73e8001470 con 0x7f73f80ad790 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 >> v1:172.21.15.42:6789/0 conn(0x7f73f80ad790 legacy=0x7f73f80c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73dc003a40 0x7f73dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc004780 0x7f73dc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73dc005130 0x7f73dc00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80ca8e0 con 0x7f73dc005130 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc00e2e0 con 0x7f73dc004780 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc00e4a0 con 0x7f73dc003a40 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73dc003a40 0x7f73dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f6800640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73dc005130 0x7f73dc00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5400640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc004780 0x7f73dc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5e00640 1 -- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc004780 msgr2=0x7f73dc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc004780 0x7f73dc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5e00640 1 -- 172.21.15.42:0/2813124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73dc005130 msgr2=0x7f73dc00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73dc005130 0x7f73dc00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.067+0000 7f73f5e00640 1 -- 172.21.15.42:0/2813124944 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0034e0 con 0x7f73dc003a40 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.068+0000 7f73f5400640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc004780 0x7f73dc004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.068+0000 7f73f6800640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73dc005130 0x7f73dc00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:35.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.068+0000 7f73f6800640 1 -- 172.21.15.42:0/2813124944 reap_dead start 2024-08-17T02:30:35.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.069+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73dc003a40 0x7f73dc003e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73e800c2a0 tx=0x7f73e8001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd1386e5c5afd1af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.069+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8005890 con 0x7f73dc003a40 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.069+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8005a10 con 0x7f73dc003a40 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.069+0000 7f73f4a00640 1 -- 172.21.15.42:0/2813124944 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8005dd0 con 0x7f73dc003a40 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.069+0000 7f73f7200640 1 -- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73dc003a40 msgr2=0x7f73dc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.069+0000 7f73f7200640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73dc003a40 0x7f73dc003e10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f73e800c2a0 tx=0x7f73e8001e70 comp rx=0 tx=0).stop 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.070+0000 7f73f7200640 1 -- 172.21.15.42:0/2813124944 shutdown_connections 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.070+0000 7f73f7200640 1 --2- 172.21.15.42:0/2813124944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73dc003a40 0x7f73dc003e10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.070+0000 7f73f7200640 1 -- 172.21.15.42:0/2813124944 >> 172.21.15.42:0/2813124944 conn(0x7f73f8062af0 msgr2=0x7f73f8062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.070+0000 7f73f7200640 1 -- 172.21.15.42:0/2813124944 shutdown_connections 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.070+0000 7f73f7200640 1 -- 172.21.15.42:0/2813124944 wait complete. 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.071+0000 7f73f7200640 1 Processor -- start 2024-08-17T02:30:35.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.071+0000 7f73f7200640 1 -- start start 2024-08-17T02:30:35.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f7200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc003a40 0x7f73f816bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f7200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73f80c1230 0x7f73f80c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 0x7f73f80b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b14e0 con 0x7f73f80b0b00 2024-08-17T02:30:35.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f7200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80c2990 con 0x7f73dc003a40 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f7200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8158660 con 0x7f73f80c1230 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 0x7f73f80b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 0x7f73f80b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55554/0 (socket says 172.21.15.42:55554) 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f6800640 1 -- 172.21.15.42:0/2426552561 learned_addr learned my addr 172.21.15.42:0/2426552561 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc003a40 0x7f73f816bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.072+0000 7f73f5400640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73f80c1230 0x7f73f80c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f6800640 1 -- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73f80c1230 msgr2=0x7f73f80c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f6800640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73f80c1230 0x7f73f80c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f6800640 1 -- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc003a40 msgr2=0x7f73f816bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f6800640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc003a40 0x7f73f816bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f6800640 1 -- 172.21.15.42:0/2426552561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80c1d80 con 0x7f73f80b0b00 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f6800640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 0x7f73f80b0fa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f73f80c8a00 tx=0x7f73f0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0013600 con 0x7f73f80b0b00 2024-08-17T02:30:35.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0013760 con 0x7f73f80b0b00 2024-08-17T02:30:35.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f80c2060 con 0x7f73f80b0b00 2024-08-17T02:30:35.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0013b00 con 0x7f73f80b0b00 2024-08-17T02:30:35.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.073+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80c2620 con 0x7f73f80b0b00 2024-08-17T02:30:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.074+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8070720 con 0x7f73f80b0b00 2024-08-17T02:30:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.075+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f73f0003030 con 0x7f73f80b0b00 2024-08-17T02:30:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.076+0000 7f73ed600640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f73d8065150 0x7f73d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.076+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f73f0082510 con 0x7f73f80b0b00 2024-08-17T02:30:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.077+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f73d8065150 0x7f73d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.077+0000 7f73f5e00640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f73d8065150 0x7f73d8067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73e8033000 tx=0x7f73e8034000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.080+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f73f0050260 con 0x7f73f80b0b00 2024-08-17T02:30:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.263+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73f80aede0 con 0x7f73f80b0b00 2024-08-17T02:30:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.264+0000 7f73ed600640 1 -- 172.21.15.42:0/2426552561 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18551 (secure 0 0 0) 0x7f73f00032e0 con 0x7f73f80b0b00 2024-08-17T02:30:35.265 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:35.265 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:28:31.012089+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:13.459105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:14.291948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f73d8065150 msgr2=0x7f73d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f73d8065150 0x7f73d8067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f73e8033000 tx=0x7f73e8034000 comp rx=0 tx=0).stop 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 msgr2=0x7f73f80b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 0x7f73f80b0fa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f73f80c8a00 tx=0x7f73f0009040 comp rx=0 tx=0).stop 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 shutdown_connections 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f73d8065150 0x7f73d8067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73f80b0b00 0x7f73f80b0fa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f73f80c1230 0x7f73f80c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 --2- 172.21.15.42:0/2426552561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73dc003a40 0x7f73f816bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.266+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 >> 172.21.15.42:0/2426552561 conn(0x7f73f8062af0 msgr2=0x7f73f8154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.267+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 shutdown_connections 2024-08-17T02:30:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.267+0000 7f73f7200640 1 -- 172.21.15.42:0/2426552561 wait complete. 2024-08-17T02:30:35.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:30:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.433+0000 7f1350e00640 1 Processor -- start 2024-08-17T02:30:35.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.434+0000 7f1350e00640 1 -- start start 2024-08-17T02:30:35.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1350e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f134c0acc60 0x7f134c0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1350e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f134c0c9740 0x7f134c0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1350e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c0c92b0 con 0x7f134c0abdf0 2024-08-17T02:30:35.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1350e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0ad5f0 con 0x7f134c0acc60 2024-08-17T02:30:35.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1350e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0c8ca0 con 0x7f134c0c9740 2024-08-17T02:30:35.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1343e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f134c0acc60 0x7f134c0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1343e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f134c0acc60 0x7f134c0ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55558/0 (socket says 172.21.15.42:55558) 2024-08-17T02:30:35.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f1343e00640 1 -- 172.21.15.42:0/3429078040 learned_addr learned my addr 172.21.15.42:0/3429078040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:35.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.435+0000 7f134be00640 1 --2- 172.21.15.42:0/3429078040 >> v2:172.21.15.62:3300/0 conn(0x7f134c0c9740 0x7f134c0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.436+0000 7f1343e00640 1 -- 172.21.15.42:0/3429078040 >> v2:172.21.15.62:3300/0 conn(0x7f134c0c9740 msgr2=0x7f134c0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:35.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.436+0000 7f1343e00640 1 --2- 172.21.15.42:0/3429078040 >> v2:172.21.15.62:3300/0 conn(0x7f134c0c9740 0x7f134c0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.436+0000 7f1343e00640 1 -- 172.21.15.42:0/3429078040 >> v1:172.21.15.62:6789/0 conn(0x7f134c0abdf0 legacy=0x7f134c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.436+0000 7f1343e00640 1 -- 172.21.15.42:0/3429078040 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c159ec0 con 0x7f134c0acc60 2024-08-17T02:30:35.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.437+0000 7f1343e00640 1 --2- 172.21.15.42:0/3429078040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c0ad0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f134c06d570 tx=0x7f13340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b35d1e2280e6e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.437+0000 7f134aa00640 1 -- 172.21.15.42:0/3429078040 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133402ae80 con 0x7f134c0acc60 2024-08-17T02:30:35.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.437+0000 7f134aa00640 1 -- 172.21.15.42:0/3429078040 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1334032440 con 0x7f134c0acc60 2024-08-17T02:30:35.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.437+0000 7f134aa00640 1 -- 172.21.15.42:0/3429078040 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334032800 con 0x7f134c0acc60 2024-08-17T02:30:35.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.437+0000 7f1350e00640 1 -- 172.21.15.42:0/3429078040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 msgr2=0x7f134c0ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.437+0000 7f1350e00640 1 --2- 172.21.15.42:0/3429078040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c0ad0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f134c06d570 tx=0x7f13340091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.438+0000 7f1350e00640 1 -- 172.21.15.42:0/3429078040 shutdown_connections 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.438+0000 7f1350e00640 1 --2- 172.21.15.42:0/3429078040 >> v2:172.21.15.62:3300/0 conn(0x7f134c0c9740 0x7f134c0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.438+0000 7f1350e00640 1 --2- 172.21.15.42:0/3429078040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c0ad0b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.438+0000 7f1350e00640 1 -- 172.21.15.42:0/3429078040 >> 172.21.15.42:0/3429078040 conn(0x7f134c066e60 msgr2=0x7f134c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.438+0000 7f1350e00640 1 -- 172.21.15.42:0/3429078040 shutdown_connections 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.438+0000 7f1350e00640 1 -- 172.21.15.42:0/3429078040 wait complete. 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.439+0000 7f1350e00640 1 Processor -- start 2024-08-17T02:30:35.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.439+0000 7f1350e00640 1 -- start start 2024-08-17T02:30:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.440+0000 7f1350e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f134c0abdf0 0x7f134c169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.440+0000 7f1350e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.440+0000 7f1350e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f134c0c9740 0x7f134c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.440+0000 7f1350e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c15a920 con 0x7f134c0acc60 2024-08-17T02:30:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.440+0000 7f1350e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c15c2c0 con 0x7f134c0abdf0 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.440+0000 7f1350e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c15c5a0 con 0x7f134c0c9740 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55568/0 (socket says 172.21.15.42:55568) 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 -- 172.21.15.42:0/1530041520 learned_addr learned my addr 172.21.15.42:0/1530041520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f134b400640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f134c0abdf0 0x7f134c169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f134be00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f134c0c9740 0x7f134c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 -- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f134c0c9740 msgr2=0x7f134c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f134c0c9740 0x7f134c15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 -- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f134c0abdf0 msgr2=0x7f134c169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f134c0abdf0 0x7f134c169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 -- 172.21.15.42:0/1530041520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334009450 con 0x7f134c0acc60 2024-08-17T02:30:35.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.441+0000 7f1343e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c15a3e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1334009210 tx=0x7f1334032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.442+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334031c80 con 0x7f134c0acc60 2024-08-17T02:30:35.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.442+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1334031e00 con 0x7f134c0acc60 2024-08-17T02:30:35.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.442+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c15c880 con 0x7f134c0acc60 2024-08-17T02:30:35.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.442+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133403d670 con 0x7f134c0acc60 2024-08-17T02:30:35.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.442+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c15d5c0 con 0x7f134c0acc60 2024-08-17T02:30:35.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.443+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c15cd80 con 0x7f134c0acc60 2024-08-17T02:30:35.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.444+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1334039040 con 0x7f134c0acc60 2024-08-17T02:30:35.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.444+0000 7f1342a00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1328065150 0x7f1328067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.444+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f13340a2620 con 0x7f134c0acc60 2024-08-17T02:30:35.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.445+0000 7f134b400640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1328065150 0x7f1328067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.445+0000 7f134b400640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1328065150 0x7f1328067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f133c007fd0 tx=0x7f133c007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.448+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1334070410 con 0x7f134c0acc60 2024-08-17T02:30:35.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.670+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f134c070720 con 0x7f134c0acc60 2024-08-17T02:30:35.671 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-08-17T02:30:35.671+0000 7f3018a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:30:35.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.675+0000 7f1342a00640 1 -- 172.21.15.42:0/1530041520 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1334073a30 con 0x7f134c0acc60 2024-08-17T02:30:35.675 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1328065150 msgr2=0x7f1328067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1328065150 0x7f1328067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f133c007fd0 tx=0x7f133c007e30 comp rx=0 tx=0).stop 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 msgr2=0x7f134c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c15a3e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1334009210 tx=0x7f1334032000 comp rx=0 tx=0).stop 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 shutdown_connections 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1328065150 0x7f1328067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f134c0c9740 0x7f134c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c0acc60 0x7f134c15a3e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 --2- 172.21.15.42:0/1530041520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f134c0abdf0 0x7f134c169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 >> 172.21.15.42:0/1530041520 conn(0x7f134c066e60 msgr2=0x7f134c0afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 shutdown_connections 2024-08-17T02:30:35.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.677+0000 7f1350e00640 1 -- 172.21.15.42:0/1530041520 wait complete. 2024-08-17T02:30:35.686 INFO:tasks.ceph.mds.c.smithi042.stderr: -7209> 2024-08-17T02:28:18.852+0000 7fa178400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:35.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:30:35.732 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-08-17T02:30:35.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.850+0000 7fc92fa00640 1 Processor -- start 2024-08-17T02:30:35.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.850+0000 7fc92fa00640 1 -- start start 2024-08-17T02:30:35.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.851+0000 7fc92fa00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9280ad960 0x7fc92815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.851+0000 7fc92fa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 0x7fc928156420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.851+0000 7fc92fa00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92815b5e0 con 0x7fc9280add30 2024-08-17T02:30:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.851+0000 7fc92fa00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280cb160 con 0x7fc9280ad960 2024-08-17T02:30:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.851+0000 7fc92fa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280b0d10 con 0x7fc9280ca050 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 0x7fc928156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc92d000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9280ad960 0x7fc92815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 0x7fc928156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.42:33794/0 (socket says 172.21.15.42:33794) 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc91fe00640 1 -- 172.21.15.42:0/3777599739 learned_addr learned my addr 172.21.15.42:0/3777599739 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc92d000640 1 -- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 msgr2=0x7fc928156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc92d000640 1 --2- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 0x7fc928156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc92d000640 1 -- 172.21.15.42:0/3777599739 >> v1:172.21.15.62:6789/0 conn(0x7fc9280add30 legacy=0x7fc928156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc92d000640 1 -- 172.21.15.42:0/3777599739 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280ca550 con 0x7fc9280ad960 2024-08-17T02:30:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.852+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 0x7fc928156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:35.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.853+0000 7fc92d000640 1 --2- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ad960 0x7fc92815b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc918009850 tx=0x7fc9180090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f27e9310dde2ed5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc927e00640 1 -- 172.21.15.42:0/3777599739 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91802ae20 con 0x7fc9280ad960 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc927e00640 1 -- 172.21.15.42:0/3777599739 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918032440 con 0x7fc9280ad960 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc927e00640 1 -- 172.21.15.42:0/3777599739 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918032820 con 0x7fc9280ad960 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 -- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ad960 msgr2=0x7fc92815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 --2- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ad960 0x7fc92815b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc918009850 tx=0x7fc9180090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 -- 172.21.15.42:0/3777599739 shutdown_connections 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 --2- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ca050 0x7fc928156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 --2- 172.21.15.42:0/3777599739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ad960 0x7fc92815b0a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 -- 172.21.15.42:0/3777599739 >> 172.21.15.42:0/3777599739 conn(0x7fc928066e60 msgr2=0x7fc928067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 -- 172.21.15.42:0/3777599739 shutdown_connections 2024-08-17T02:30:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.854+0000 7fc92fa00640 1 -- 172.21.15.42:0/3777599739 wait complete. 2024-08-17T02:30:35.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.856+0000 7fc92fa00640 1 Processor -- start 2024-08-17T02:30:35.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.856+0000 7fc92fa00640 1 -- start start 2024-08-17T02:30:35.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.856+0000 7fc92fa00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ad960 0x7fc928144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.856+0000 7fc92fa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 0x7fc9280a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92fa00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ca050 0x7fc9281561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92fa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9281691e0 con 0x7fc9280add30 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92fa00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928169430 con 0x7fc9280ca050 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92fa00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc928169710 con 0x7fc9280ad960 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 0x7fc9280a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 0x7fc9280a9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55594/0 (socket says 172.21.15.42:55594) 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 -- 172.21.15.42:0/1335157536 learned_addr learned my addr 172.21.15.42:0/1335157536 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92da00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ca050 0x7fc9281561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92d000640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ad960 0x7fc928144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 -- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ad960 msgr2=0x7fc928144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ad960 0x7fc928144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 -- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ca050 msgr2=0x7fc9281561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ca050 0x7fc9281561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc91fe00640 1 -- 172.21.15.42:0/1335157536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910009450 con 0x7fc9280add30 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.857+0000 7fc92da00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ca050 0x7fc9281561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.858+0000 7fc91fe00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 0x7fc9280a9470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc91000ea50 tx=0x7fc9100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.858+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000ca10 con 0x7fc9280add30 2024-08-17T02:30:35.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.858+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000cb70 con 0x7fc9280add30 2024-08-17T02:30:35.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.858+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910013470 con 0x7fc9280add30 2024-08-17T02:30:35.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.858+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc918009390 con 0x7fc9280add30 2024-08-17T02:30:35.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.858+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc928169cd0 con 0x7fc9280add30 2024-08-17T02:30:35.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.859+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928063fb0 con 0x7fc9280add30 2024-08-17T02:30:35.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.860+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc9100137e0 con 0x7fc9280add30 2024-08-17T02:30:35.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.861+0000 7fc924c00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc904065180 0x7fc904067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:35.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.861+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fc910082bb0 con 0x7fc9280add30 2024-08-17T02:30:35.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.861+0000 7fc92d000640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc904065180 0x7fc904067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:35.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.862+0000 7fc92d000640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc904065180 0x7fc904067630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc918034000 tx=0x7fc918032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:35.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:35.865+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9100507f0 con 0x7fc9280add30 2024-08-17T02:30:36.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.095+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc928152210 con 0x7fc9280add30 2024-08-17T02:30:36.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.676+0000 7fc924c00640 1 -- 172.21.15.42:0/1335157536 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc910053e10 con 0x7fc9280add30 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.678+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc904065180 msgr2=0x7fc904067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.678+0000 7fc92fa00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc904065180 0x7fc904067630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc918034000 tx=0x7fc918032000 comp rx=0 tx=0).stop 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.678+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 msgr2=0x7fc9280a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.678+0000 7fc92fa00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 0x7fc9280a9470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc91000ea50 tx=0x7fc9100091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 shutdown_connections 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc904065180 0x7fc904067630 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9280ca050 0x7fc9281561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9280add30 0x7fc9280a9470 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 --2- 172.21.15.42:0/1335157536 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9280ad960 0x7fc928144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 >> 172.21.15.42:0/1335157536 conn(0x7fc928066e60 msgr2=0x7fc928151330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 shutdown_connections 2024-08-17T02:30:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.679+0000 7fc92fa00640 1 -- 172.21.15.42:0/1335157536 wait complete. 2024-08-17T02:30:36.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:30:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.894+0000 7f3b3d200640 1 Processor -- start 2024-08-17T02:30:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.894+0000 7f3b3d200640 1 -- start start 2024-08-17T02:30:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.895+0000 7f3b3d200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b38156a90 0x7f3b380ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.895+0000 7f3b3d200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b381582b0 con 0x7f3b380adba0 2024-08-17T02:30:36.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.895+0000 7f3b3d200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380ca110 con 0x7f3b380aef00 2024-08-17T02:30:36.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.895+0000 7f3b3d200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b380c9f80 con 0x7f3b38156a90 2024-08-17T02:30:36.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b35400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3b380adba0 0x7f3b380ae7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38582/0 (socket says 172.21.15.42:38582) 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b35400640 1 -- 172.21.15.42:0/4286845391 learned_addr learned my addr 172.21.15.42:0/4286845391 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b35e00640 1 --2- 172.21.15.42:0/4286845391 >> v2:172.21.15.42:3300/0 conn(0x7f3b38156a90 0x7f3b380ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b34a00640 1 -- 172.21.15.42:0/4286845391 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098477756 0 0) 0x7f3b381582b0 con 0x7f3b380adba0 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b34a00640 1 -- 172.21.15.42:0/4286845391 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c0034e0 con 0x7f3b380adba0 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b34a00640 1 -- 172.21.15.42:0/4286845391 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245943158 0 0) 0x7f3b380ca110 con 0x7f3b380aef00 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b35e00640 1 -- 172.21.15.42:0/4286845391 >> v1:172.21.15.62:6789/0 conn(0x7f3b380aef00 legacy=0x7f3b380ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b35e00640 1 -- 172.21.15.42:0/4286845391 >> v1:172.21.15.42:6789/0 conn(0x7f3b380adba0 legacy=0x7f3b380ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.896+0000 7f3b35e00640 1 -- 172.21.15.42:0/4286845391 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b380adff0 con 0x7f3b38156a90 2024-08-17T02:30:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.897+0000 7f3b35e00640 1 --2- 172.21.15.42:0/4286845391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b380ad660 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009850 tx=0x7f3b280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29e79e55a32c350 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.897+0000 7f3b34a00640 1 -- 172.21.15.42:0/4286845391 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2802ae20 con 0x7f3b38156a90 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.897+0000 7f3b34a00640 1 -- 172.21.15.42:0/4286845391 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28032440 con 0x7f3b38156a90 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.897+0000 7f3b34a00640 1 -- 172.21.15.42:0/4286845391 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b280327e0 con 0x7f3b38156a90 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 -- 172.21.15.42:0/4286845391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 msgr2=0x7f3b380ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 --2- 172.21.15.42:0/4286845391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b380ad660 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009850 tx=0x7f3b280090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 -- 172.21.15.42:0/4286845391 shutdown_connections 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 --2- 172.21.15.42:0/4286845391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b380ad660 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 -- 172.21.15.42:0/4286845391 >> 172.21.15.42:0/4286845391 conn(0x7f3b38066e60 msgr2=0x7f3b38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 -- 172.21.15.42:0/4286845391 shutdown_connections 2024-08-17T02:30:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.898+0000 7f3b3d200640 1 -- 172.21.15.42:0/4286845391 wait complete. 2024-08-17T02:30:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.899+0000 7f3b3d200640 1 Processor -- start 2024-08-17T02:30:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 -- start start 2024-08-17T02:30:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b380adba0 0x7f3b380ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b380aef00 0x7f3b380abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b3814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380ad510 con 0x7f3b38156a90 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380ad080 con 0x7f3b380aef00 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.900+0000 7f3b3d200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380ac470 con 0x7f3b380adba0 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b3814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b3814a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55610/0 (socket says 172.21.15.42:55610) 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 -- 172.21.15.42:0/3388425716 learned_addr learned my addr 172.21.15.42:0/3388425716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b35400640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b380aef00 0x7f3b380abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b35e00640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b380adba0 0x7f3b380ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 -- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b380adba0 msgr2=0x7f3b380ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b380adba0 0x7f3b380ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 -- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b380aef00 msgr2=0x7f3b380abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:36.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b380aef00 0x7f3b380abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:36.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b36800640 1 -- 172.21.15.42:0/3388425716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009390 con 0x7f3b38156a90 2024-08-17T02:30:36.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.901+0000 7f3b35400640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b380aef00 0x7f3b380abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:36.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.902+0000 7f3b36800640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b3814a630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b30001560 tx=0x7f3b300016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:36.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.902+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000a7f0 con 0x7f3b38156a90 2024-08-17T02:30:36.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.902+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3000a950 con 0x7f3b38156a90 2024-08-17T02:30:36.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.902+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b380ac750 con 0x7f3b38156a90 2024-08-17T02:30:36.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.902+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000ad10 con 0x7f3b38156a90 2024-08-17T02:30:36.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.902+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b380acd10 con 0x7f3b38156a90 2024-08-17T02:30:36.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.903+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b380ad210 con 0x7f3b38156a90 2024-08-17T02:30:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.904+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3b30003030 con 0x7f3b38156a90 2024-08-17T02:30:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.905+0000 7f3b2d600640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3b18065150 0x7f3b18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.905+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f3b30082a10 con 0x7f3b38156a90 2024-08-17T02:30:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.905+0000 7f3b35e00640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3b18065150 0x7f3b18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:36.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.906+0000 7f3b35e00640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3b18065150 0x7f3b18067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3b28034000 tx=0x7f3b28032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:36.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:36.909+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3b30050650 con 0x7f3b38156a90 2024-08-17T02:30:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.093+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b38063fb0 con 0x7f3b38156a90 2024-08-17T02:30:37.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.681+0000 7f3b2d600640 1 -- 172.21.15.42:0/3388425716 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3b30053c70 con 0x7f3b38156a90 2024-08-17T02:30:37.682 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:30:37.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3b18065150 msgr2=0x7f3b18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3b18065150 0x7f3b18067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3b28034000 tx=0x7f3b28032000 comp rx=0 tx=0).stop 2024-08-17T02:30:37.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 msgr2=0x7f3b3814a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b3814a630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b30001560 tx=0x7f3b300016c0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 shutdown_connections 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f3b18065150 0x7f3b18067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b38156a90 0x7f3b3814a630 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b380aef00 0x7f3b380abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 --2- 172.21.15.42:0/3388425716 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b380adba0 0x7f3b380ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 >> 172.21.15.42:0/3388425716 conn(0x7f3b38066e60 msgr2=0x7f3b38158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 shutdown_connections 2024-08-17T02:30:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.685+0000 7f3b3d200640 1 -- 172.21.15.42:0/3388425716 wait complete. 2024-08-17T02:30:37.704 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:30:37.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.861+0000 7f8447000640 1 Processor -- start 2024-08-17T02:30:37.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.861+0000 7f8447000640 1 -- start start 2024-08-17T02:30:37.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.862+0000 7f8447000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 0x7f844006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.862+0000 7f8447000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84400cd450 con 0x7f84401589a0 2024-08-17T02:30:37.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.862+0000 7f8447000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844015a250 con 0x7f84400acda0 2024-08-17T02:30:37.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.862+0000 7f8447000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400af3f0 con 0x7f84400aef70 2024-08-17T02:30:37.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.862+0000 7f843fe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f84401589a0 0x7f8440158d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38588/0 (socket says 172.21.15.42:38588) 2024-08-17T02:30:37.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.862+0000 7f843fe00640 1 -- 172.21.15.42:0/2123434022 learned_addr learned my addr 172.21.15.42:0/2123434022 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:37.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f8445000640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 0x7f844006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331690718 0 0) 0x7f84400cd450 con 0x7f84401589a0 2024-08-17T02:30:37.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84240034e0 con 0x7f84401589a0 2024-08-17T02:30:37.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754639776 0 0) 0x7f84240034e0 con 0x7f84401589a0 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 msgr2=0x7f844006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 0x7f844006e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 >> v1:172.21.15.62:6789/0 conn(0x7f84400acda0 legacy=0x7f8440159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400ad380 con 0x7f84401589a0 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f8430001470 con 0x7f84401589a0 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 >> v1:172.21.15.42:6789/0 conn(0x7f84401589a0 legacy=0x7f8440158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f8424003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 0x7f8424004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8424004cc0 0x7f8424005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400af3f0 con 0x7f8424003a00 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842400bb60 con 0x7f8424004cc0 2024-08-17T02:30:37.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.863+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842400bcf0 con 0x7f84400aef70 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843fe00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f8424003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843f400640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 0x7f8424004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f8445000640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8424004cc0 0x7f8424005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843fe00640 1 -- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 msgr2=0x7f8424004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843fe00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84400aef70 0x7f8424004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843fe00640 1 -- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8424004cc0 msgr2=0x7f8424005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843fe00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8424004cc0 0x7f8424005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f843fe00640 1 -- 172.21.15.42:0/2123434022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240034e0 con 0x7f8424003a00 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.864+0000 7f8445000640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8424004cc0 0x7f8424005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.865+0000 7f843fe00640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f8424003e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f843000c190 tx=0x7f8430001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a56ed4d78a0fd5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.865+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430005890 con 0x7f8424003a00 2024-08-17T02:30:37.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.865+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843002d070 con 0x7f8424003a00 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.865+0000 7f843ea00640 1 -- 172.21.15.42:0/2123434022 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430005a50 con 0x7f8424003a00 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8447000640 1 -- 172.21.15.42:0/2123434022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 msgr2=0x7f8424003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8447000640 1 --2- 172.21.15.42:0/2123434022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f8424003e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f843000c190 tx=0x7f8430001d80 comp rx=0 tx=0).stop 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8445000640 1 -- 172.21.15.42:0/2123434022 reap_dead start 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8447000640 1 -- 172.21.15.42:0/2123434022 shutdown_connections 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8447000640 1 -- 172.21.15.42:0/2123434022 >> 172.21.15.42:0/2123434022 conn(0x7f844006c760 msgr2=0x7f844006cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8447000640 1 -- 172.21.15.42:0/2123434022 shutdown_connections 2024-08-17T02:30:37.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.866+0000 7f8447000640 1 -- 172.21.15.42:0/2123434022 wait complete. 2024-08-17T02:30:37.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.867+0000 7f8447000640 1 Processor -- start 2024-08-17T02:30:37.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.867+0000 7f8447000640 1 -- start start 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.868+0000 7f8447000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f84400c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.868+0000 7f8447000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8440143420 0x7f844006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.868+0000 7f8447000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f844006af00 0x7f844016cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.868+0000 7f8447000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844006b3a0 con 0x7f8424003a00 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.868+0000 7f8447000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c8150 con 0x7f8440143420 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.868+0000 7f8447000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c7540 con 0x7f844006af00 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f84400c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f84400c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55626/0 (socket says 172.21.15.42:55626) 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 -- 172.21.15.42:0/1581498877 learned_addr learned my addr 172.21.15.42:0/1581498877 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f8445000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f844006af00 0x7f844016cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843f400640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8440143420 0x7f844006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 -- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f844006af00 msgr2=0x7f844016cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f844006af00 0x7f844016cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 -- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8440143420 msgr2=0x7f844006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8440143420 0x7f844006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 -- 172.21.15.42:0/1581498877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400c7820 con 0x7f8424003a00 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f8445000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f844006af00 0x7f844016cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843f400640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8440143420 0x7f844006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.869+0000 7f843fe00640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f84400c65f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f843002ad20 tx=0x7f8430033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.870+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430007140 con 0x7f8424003a00 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.870+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300072a0 con 0x7f8424003a00 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.870+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400c7b00 con 0x7f8424003a00 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.870+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430007640 con 0x7f8424003a00 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.870+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84400c6b30 con 0x7f8424003a00 2024-08-17T02:30:37.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.871+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8440069310 con 0x7f8424003a00 2024-08-17T02:30:37.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.872+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f843003c040 con 0x7f8424003a00 2024-08-17T02:30:37.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.872+0000 7f8437400640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8420065150 0x7f8420067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:37.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.873+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f84300a2eb0 con 0x7f8424003a00 2024-08-17T02:30:37.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.873+0000 7f843f400640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8420065150 0x7f8420067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:37.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.873+0000 7f843f400640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8420065150 0x7f8420067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f842c000c00 tx=0x7f842c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:37.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:37.876+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8430070cb0 con 0x7f8424003a00 2024-08-17T02:30:38.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.063+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8440069310 con 0x7f8424003a00 2024-08-17T02:30:38.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.690+0000 7f8437400640 1 -- 172.21.15.42:0/1581498877 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f84300742d0 con 0x7f8424003a00 2024-08-17T02:30:38.690 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8420065150 msgr2=0x7f8420067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8420065150 0x7f8420067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f842c000c00 tx=0x7f842c009040 comp rx=0 tx=0).stop 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 msgr2=0x7f84400c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f84400c65f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f843002ad20 tx=0x7f8430033000 comp rx=0 tx=0).stop 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 shutdown_connections 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8420065150 0x7f8420067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f844006af00 0x7f844016cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8440143420 0x7f844006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 --2- 172.21.15.42:0/1581498877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8424003a00 0x7f84400c65f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 >> 172.21.15.42:0/1581498877 conn(0x7f844006c760 msgr2=0x7f844015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:38.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.693+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 shutdown_connections 2024-08-17T02:30:38.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.694+0000 7f8447000640 1 -- 172.21.15.42:0/1581498877 wait complete. 2024-08-17T02:30:38.712 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:38.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.872+0000 7f1bd7000640 1 Processor -- start 2024-08-17T02:30:38.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.872+0000 7f1bd7000640 1 -- start start 2024-08-17T02:30:38.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd7000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1bd0159dd0 0x7f1bd015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd7000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd7000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd00ce830 con 0x7f1bd0153070 2024-08-17T02:30:38.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd7000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd00cdca0 con 0x7f1bd0159dd0 2024-08-17T02:30:38.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd7000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00cdf40 con 0x7f1bd00cc5a0 2024-08-17T02:30:38.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd5200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1bd0159dd0 0x7f1bd015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd5c00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1bd0153070 0x7f1bd00cab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38598/0 (socket says 172.21.15.42:38598) 2024-08-17T02:30:38.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.873+0000 7f1bd5c00640 1 -- 172.21.15.42:0/4289228486 learned_addr learned my addr 172.21.15.42:0/4289228486 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.874+0000 7f1bd6600640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.874+0000 7f1bd5200640 1 -- 172.21.15.42:0/4289228486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 msgr2=0x7f1bd00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.874+0000 7f1bd5200640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd00cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.874+0000 7f1bd5200640 1 -- 172.21.15.42:0/4289228486 >> v1:172.21.15.42:6789/0 conn(0x7f1bd0153070 legacy=0x7f1bd00cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.874+0000 7f1bd5200640 1 -- 172.21.15.42:0/4289228486 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00ccf60 con 0x7f1bd0159dd0 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.874+0000 7f1bd6600640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.875+0000 7f1bd5200640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0159dd0 0x7f1bd015a2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009850 tx=0x7f1bbc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40472826fe1e559 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.875+0000 7f1bcfe00640 1 -- 172.21.15.42:0/4289228486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc02ad00 con 0x7f1bd0159dd0 2024-08-17T02:30:38.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.875+0000 7f1bcfe00640 1 -- 172.21.15.42:0/4289228486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc02ae60 con 0x7f1bd0159dd0 2024-08-17T02:30:38.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.875+0000 7f1bcfe00640 1 -- 172.21.15.42:0/4289228486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc032670 con 0x7f1bd0159dd0 2024-08-17T02:30:38.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.875+0000 7f1bd7000640 1 -- 172.21.15.42:0/4289228486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0159dd0 msgr2=0x7f1bd015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.875+0000 7f1bd7000640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0159dd0 0x7f1bd015a2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009850 tx=0x7f1bbc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.876+0000 7f1bd7000640 1 -- 172.21.15.42:0/4289228486 shutdown_connections 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.876+0000 7f1bd7000640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.876+0000 7f1bd7000640 1 --2- 172.21.15.42:0/4289228486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0159dd0 0x7f1bd015a2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.876+0000 7f1bd7000640 1 -- 172.21.15.42:0/4289228486 >> 172.21.15.42:0/4289228486 conn(0x7f1bd0087a80 msgr2=0x7f1bd006e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.876+0000 7f1bd7000640 1 -- 172.21.15.42:0/4289228486 shutdown_connections 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.876+0000 7f1bd7000640 1 -- 172.21.15.42:0/4289228486 wait complete. 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.877+0000 7f1bd7000640 1 Processor -- start 2024-08-17T02:30:38.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.877+0000 7f1bd7000640 1 -- start start 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd7000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd016bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd7000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 0x7f1bd0154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd7000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bd0159dd0 0x7f1bd00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd7000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01563f0 con 0x7f1bd0153070 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd7000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd01557e0 con 0x7f1bd0159dd0 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd7000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0155ac0 con 0x7f1bd00cc5a0 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 0x7f1bd0154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 0x7f1bd0154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55658/0 (socket says 172.21.15.42:55658) 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd5200640 1 -- 172.21.15.42:0/3909463977 learned_addr learned my addr 172.21.15.42:0/3909463977 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.878+0000 7f1bd5c00640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd016bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd6600640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bd0159dd0 0x7f1bd00c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5200640 1 -- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 msgr2=0x7f1bd016bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5200640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd016bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5200640 1 -- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bd0159dd0 msgr2=0x7f1bd00c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5200640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bd0159dd0 0x7f1bd00c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5200640 1 -- 172.21.15.42:0/3909463977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc009390 con 0x7f1bd0153070 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5c00640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd016bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bd5200640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 0x7f1bd0154ce0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009360 tx=0x7f1bbc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc032e20 con 0x7f1bd0153070 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc031a60 con 0x7f1bd0153070 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.879+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc031e20 con 0x7f1bd0153070 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.880+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd0155da0 con 0x7f1bd0153070 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.880+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd016c180 con 0x7f1bd0153070 2024-08-17T02:30:38.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.881+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd01565a0 con 0x7f1bd0153070 2024-08-17T02:30:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.881+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1bbc039040 con 0x7f1bd0153070 2024-08-17T02:30:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.882+0000 7f1bccc00640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1bb0065180 0x7f1bb0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.882+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1bbc041030 con 0x7f1bd0153070 2024-08-17T02:30:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.882+0000 7f1bd5c00640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1bb0065180 0x7f1bb0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.883+0000 7f1bd5c00640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1bb0065180 0x7f1bb0067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4001840 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:38.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:38.886+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1bd01565a0 con 0x7f1bd0153070 2024-08-17T02:30:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.072+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bd0070720 con 0x7f1bd0153070 2024-08-17T02:30:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.073+0000 7f1bccc00640 1 -- 172.21.15.42:0/3909463977 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15464 (secure 0 0 0) 0x7f1bbc037090 con 0x7f1bd0153070 2024-08-17T02:30:39.073 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:39.074 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":40,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:30:38.681039+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6836/3869657839":"2024-08-18T02:30:35.671511+0000","172.21.15.42:6834/3869657839":"2024-08-18T02:30:35.671511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1bb0065180 msgr2=0x7f1bb0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1bb0065180 0x7f1bb0067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4001840 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 msgr2=0x7f1bd0154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 0x7f1bd0154ce0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009360 tx=0x7f1bbc032000 comp rx=0 tx=0).stop 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 shutdown_connections 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1bb0065180 0x7f1bb0067630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1bd0159dd0 0x7f1bd00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bd0153070 0x7f1bd0154ce0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 --2- 172.21.15.42:0/3909463977 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1bd00cc5a0 0x7f1bd016bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 >> 172.21.15.42:0/3909463977 conn(0x7f1bd0087a80 msgr2=0x7f1bd00cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.075+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 shutdown_connections 2024-08-17T02:30:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.076+0000 7f1bd7000640 1 -- 172.21.15.42:0/3909463977 wait complete. 2024-08-17T02:30:39.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:19.238087+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000001039443.meta', 'create_time': '2024-08-17T02:28:26.181709+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000001039443'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000001039443.data', 'create_time': '2024-08-17T02:28:27.046060+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000001039443'}}}] 2024-08-17T02:30:39.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.246+0000 7ff392a00640 1 Processor -- start 2024-08-17T02:30:39.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.246+0000 7ff392a00640 1 -- start start 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.247+0000 7ff392a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff38c156bd0 0x7ff38c0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff392a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c0ac040 con 0x7ff38c0adf90 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff392a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c0ab150 con 0x7ff38c156fa0 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff392a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c067810 con 0x7ff38c156bd0 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff38c156bd0 0x7ff38c0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38b400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff38c0adf90 0x7ff38c0ac4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38602/0 (socket says 172.21.15.42:38602) 2024-08-17T02:30:39.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38b400640 1 -- 172.21.15.42:0/233783973 learned_addr learned my addr 172.21.15.42:0/233783973 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:39.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38be00640 1 -- 172.21.15.42:0/233783973 >> v1:172.21.15.62:6789/0 conn(0x7ff38c156fa0 legacy=0x7ff38c0acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38be00640 1 -- 172.21.15.42:0/233783973 >> v1:172.21.15.42:6789/0 conn(0x7ff38c0adf90 legacy=0x7ff38c0ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38aa00640 1 -- 172.21.15.42:0/233783973 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029117724 0 0) 0x7ff38c0ac040 con 0x7ff38c0adf90 2024-08-17T02:30:39.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.248+0000 7ff38be00640 1 -- 172.21.15.42:0/233783973 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0ab430 con 0x7ff38c156bd0 2024-08-17T02:30:39.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.249+0000 7ff38be00640 1 --2- 172.21.15.42:0/233783973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156bd0 0x7ff38c0b0b70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009880 tx=0x7ff37c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917b02a07fe944aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff38aa00640 1 -- 172.21.15.42:0/233783973 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c02ae20 con 0x7ff38c156bd0 2024-08-17T02:30:39.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff38aa00640 1 -- 172.21.15.42:0/233783973 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c032440 con 0x7ff38c156bd0 2024-08-17T02:30:39.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff38aa00640 1 -- 172.21.15.42:0/233783973 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c0327e0 con 0x7ff38c156bd0 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 -- 172.21.15.42:0/233783973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156bd0 msgr2=0x7ff38c0b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 --2- 172.21.15.42:0/233783973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156bd0 0x7ff38c0b0b70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009880 tx=0x7ff37c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 -- 172.21.15.42:0/233783973 shutdown_connections 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 --2- 172.21.15.42:0/233783973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156bd0 0x7ff38c0b0b70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 -- 172.21.15.42:0/233783973 >> 172.21.15.42:0/233783973 conn(0x7ff38c0cc390 msgr2=0x7ff38c066e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 -- 172.21.15.42:0/233783973 shutdown_connections 2024-08-17T02:30:39.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.250+0000 7ff392a00640 1 -- 172.21.15.42:0/233783973 wait complete. 2024-08-17T02:30:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.252+0000 7ff392a00640 1 Processor -- start 2024-08-17T02:30:39.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.252+0000 7ff392a00640 1 -- start start 2024-08-17T02:30:39.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff392a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 0x7ff38c149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff392a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff38c156bd0 0x7ff38c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff392a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156fa0 0x7ff38c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff392a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0aa7b0 con 0x7ff38c156fa0 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff392a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c158760 con 0x7ff38c0adf90 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff392a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c157b50 con 0x7ff38c156bd0 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff38be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 0x7ff38c149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff390a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156fa0 0x7ff38c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff38be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 0x7ff38c149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:48350/0 (socket says 172.21.15.42:48350) 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff38be00640 1 -- 172.21.15.42:0/1349174127 learned_addr learned my addr 172.21.15.42:0/1349174127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:39.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.253+0000 7ff38b400640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff38c156bd0 0x7ff38c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff390a00640 1 -- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff38c156bd0 msgr2=0x7ff38c158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff390a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff38c156bd0 0x7ff38c158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff390a00640 1 -- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 msgr2=0x7ff38c149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff390a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 0x7ff38c149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff390a00640 1 -- 172.21.15.42:0/1349174127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c009390 con 0x7ff38c156fa0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff38be00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 0x7ff38c149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff390a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156fa0 0x7ff38c157450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c790 tx=0x7ff384001560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400a640 con 0x7ff38c156fa0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400a7c0 con 0x7ff38c156fa0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400ab80 con 0x7ff38c156fa0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c157e30 con 0x7ff38c156fa0 2024-08-17T02:30:39.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.254+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c1583f0 con 0x7ff38c156fa0 2024-08-17T02:30:39.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.255+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c158910 con 0x7ff38c156fa0 2024-08-17T02:30:39.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.256+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff384003030 con 0x7ff38c156fa0 2024-08-17T02:30:39.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.257+0000 7ff383400640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff36c065150 0x7ff36c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.257+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff3840822f0 con 0x7ff38c156fa0 2024-08-17T02:30:39.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.257+0000 7ff38be00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff36c065150 0x7ff36c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.258+0000 7ff38be00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff36c065150 0x7ff36c067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009130 tx=0x7ff37c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.261+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff38c158910 con 0x7ff38c156fa0 2024-08-17T02:30:39.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.441+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff38c1588d0 con 0x7ff38c156fa0 2024-08-17T02:30:39.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.442+0000 7ff383400640 1 -- 172.21.15.42:0/1349174127 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff384050340 con 0x7ff38c156fa0 2024-08-17T02:30:39.442 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-08-17T02:30:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff36c065150 msgr2=0x7ff36c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff36c065150 0x7ff36c067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009130 tx=0x7ff37c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156fa0 msgr2=0x7ff38c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156fa0 0x7ff38c157450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c790 tx=0x7ff384001560 comp rx=0 tx=0).stop 2024-08-17T02:30:39.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 shutdown_connections 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7ff36c065150 0x7ff36c067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff38c156fa0 0x7ff38c157450 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff38c156bd0 0x7ff38c158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 --2- 172.21.15.42:0/1349174127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff38c0adf90 0x7ff38c149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 >> 172.21.15.42:0/1349174127 conn(0x7ff38c0cc390 msgr2=0x7ff38c153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 shutdown_connections 2024-08-17T02:30:39.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.444+0000 7ff392a00640 1 -- 172.21.15.42:0/1349174127 wait complete. 2024-08-17T02:30:39.459 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039443.meta pg_num 2024-08-17T02:30:39.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.613+0000 7f3317400640 1 Processor -- start 2024-08-17T02:30:39.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.613+0000 7f3317400640 1 -- start start 2024-08-17T02:30:39.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f3317400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f33100ad960 0x7f331015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f3317400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33100add30 0x7f3310156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f3317400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331015b5e0 con 0x7f33100ca050 2024-08-17T02:30:39.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f3317400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33100cb160 con 0x7f33100ad960 2024-08-17T02:30:39.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f3317400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33100b0d10 con 0x7f33100add30 2024-08-17T02:30:39.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f330fe00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f33100ca050 0x7f3310156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38618/0 (socket says 172.21.15.42:38618) 2024-08-17T02:30:39.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f330fe00640 1 -- 172.21.15.42:0/3442159796 learned_addr learned my addr 172.21.15.42:0/3442159796 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:39.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.614+0000 7f3314a00640 1 --2- 172.21.15.42:0/3442159796 >> v2:172.21.15.42:3300/0 conn(0x7f33100ad960 0x7f331015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.615+0000 7f3315400640 1 --2- 172.21.15.42:0/3442159796 >> v2:172.21.15.62:3300/0 conn(0x7f33100add30 0x7f3310156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.615+0000 7f3314a00640 1 -- 172.21.15.42:0/3442159796 >> v2:172.21.15.62:3300/0 conn(0x7f33100add30 msgr2=0x7f3310156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.615+0000 7f3314a00640 1 --2- 172.21.15.42:0/3442159796 >> v2:172.21.15.62:3300/0 conn(0x7f33100add30 0x7f3310156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.615+0000 7f3314a00640 1 -- 172.21.15.42:0/3442159796 >> v1:172.21.15.42:6789/0 conn(0x7f33100ca050 legacy=0x7f3310156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.615+0000 7f3314a00640 1 -- 172.21.15.42:0/3442159796 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33100ca550 con 0x7f33100ad960 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.615+0000 7f330f400640 1 -- 172.21.15.42:0/3442159796 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709395554 0 0) 0x7f32fc001110 con 0x7f33100ca050 2024-08-17T02:30:39.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.616+0000 7f3314a00640 1 --2- 172.21.15.42:0/3442159796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100ad960 0x7f331015b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f33100cb0d0 tx=0x7f33040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c17448a871187 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.616+0000 7f330f400640 1 -- 172.21.15.42:0/3442159796 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330402ae40 con 0x7f33100ad960 2024-08-17T02:30:39.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.616+0000 7f330f400640 1 -- 172.21.15.42:0/3442159796 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3304032440 con 0x7f33100ad960 2024-08-17T02:30:39.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.616+0000 7f330f400640 1 -- 172.21.15.42:0/3442159796 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33040327e0 con 0x7f33100ad960 2024-08-17T02:30:39.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 -- 172.21.15.42:0/3442159796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100ad960 msgr2=0x7f331015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 --2- 172.21.15.42:0/3442159796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100ad960 0x7f331015b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f33100cb0d0 tx=0x7f33040090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 -- 172.21.15.42:0/3442159796 shutdown_connections 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 --2- 172.21.15.42:0/3442159796 >> v2:172.21.15.62:3300/0 conn(0x7f33100add30 0x7f3310156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 --2- 172.21.15.42:0/3442159796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100ad960 0x7f331015b0a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 -- 172.21.15.42:0/3442159796 >> 172.21.15.42:0/3442159796 conn(0x7f3310066e60 msgr2=0x7f3310067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 -- 172.21.15.42:0/3442159796 shutdown_connections 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.617+0000 7f3317400640 1 -- 172.21.15.42:0/3442159796 wait complete. 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.618+0000 7f3317400640 1 Processor -- start 2024-08-17T02:30:39.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.618+0000 7f3317400640 1 -- start start 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f3317400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33100ad960 0x7f3310157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f3317400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 0x7f33100aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f3317400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33100ca050 0x7f331014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f3317400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33101501a0 con 0x7f33100add30 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f3317400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33101584c0 con 0x7f33100ca050 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f3317400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331014f870 con 0x7f33100ad960 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.619+0000 7f330fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 0x7f33100aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 0x7f33100aa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55680/0 (socket says 172.21.15.42:55680) 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 -- 172.21.15.42:0/316360045 learned_addr learned my addr 172.21.15.42:0/316360045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f3314a00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33100ad960 0x7f3310157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 -- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33100ad960 msgr2=0x7f3310157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33100ad960 0x7f3310157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 -- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33100ca050 msgr2=0x7f331014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33100ca050 0x7f331014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 -- 172.21.15.42:0/316360045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304009390 con 0x7f33100add30 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f330fe00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 0x7f33100aa7f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c810 tx=0x7f32fc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.620+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc005870 con 0x7f33100add30 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.621+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc0059d0 con 0x7f33100add30 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.621+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc005dd0 con 0x7f33100add30 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.621+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331014fb50 con 0x7f33100add30 2024-08-17T02:30:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.621+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3310167f20 con 0x7f33100add30 2024-08-17T02:30:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.622+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3310150310 con 0x7f33100add30 2024-08-17T02:30:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.622+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f32fc007300 con 0x7f33100add30 2024-08-17T02:30:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.623+0000 7f3303e00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f0065150 0x7f32f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.623+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f32fc081d90 con 0x7f33100add30 2024-08-17T02:30:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.623+0000 7f3314a00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f0065150 0x7f32f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.624+0000 7f3314a00640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f0065150 0x7f32f0067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3304034000 tx=0x7f3304032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.627+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32fc04fdb0 con 0x7f33100add30 2024-08-17T02:30:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.810+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.meta", "var": "pg_num"} v 0) v1 -- 0x7f331015b5e0 con 0x7f33100add30 2024-08-17T02:30:39.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.810+0000 7f3303e00640 1 -- 172.21.15.42:0/316360045 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f331015b5e0 con 0x7f33100add30 2024-08-17T02:30:39.812 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:30:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.812+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f0065150 msgr2=0x7f32f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.812+0000 7f3317400640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f0065150 0x7f32f0067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3304034000 tx=0x7f3304032000 comp rx=0 tx=0).stop 2024-08-17T02:30:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 msgr2=0x7f33100aa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 0x7f33100aa7f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c810 tx=0x7f32fc007bc0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 shutdown_connections 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f32f0065150 0x7f32f0067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33100ca050 0x7f331014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33100add30 0x7f33100aa7f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 --2- 172.21.15.42:0/316360045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33100ad960 0x7f3310157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 >> 172.21.15.42:0/316360045 conn(0x7f3310066e60 msgr2=0x7f3310153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 shutdown_connections 2024-08-17T02:30:39.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.813+0000 7f3317400640 1 -- 172.21.15.42:0/316360045 wait complete. 2024-08-17T02:30:39.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000001039443.data pg_num 2024-08-17T02:30:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.982+0000 7f0358a00640 1 Processor -- start 2024-08-17T02:30:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.982+0000 7f0358a00640 1 -- start start 2024-08-17T02:30:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0358a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ca050 0x7f0354156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0358a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03540add30 0x7f035415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0358a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035415b5e0 con 0x7f03540ad960 2024-08-17T02:30:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0358a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540cb160 con 0x7f03540add30 2024-08-17T02:30:39.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0358a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b0d10 con 0x7f03540ca050 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0352800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f03540add30 0x7f035415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0351e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f03540ad960 0x7f0354156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38632/0 (socket says 172.21.15.42:38632) 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0351e00640 1 -- 172.21.15.42:0/791462463 learned_addr learned my addr 172.21.15.42:0/791462463 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f034be00640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ca050 0x7f0354156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0352800640 1 -- 172.21.15.42:0/791462463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ca050 msgr2=0x7f0354156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0352800640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ca050 0x7f0354156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0352800640 1 -- 172.21.15.42:0/791462463 >> v1:172.21.15.42:6789/0 conn(0x7f03540ad960 legacy=0x7f0354156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0352800640 1 -- 172.21.15.42:0/791462463 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540ca550 con 0x7f03540add30 2024-08-17T02:30:39.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f034be00640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ca050 0x7f0354156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:39.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.984+0000 7f0351400640 1 -- 172.21.15.42:0/791462463 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295191291 0 0) 0x7f0344001110 con 0x7f03540ad960 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.985+0000 7f0352800640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f035415b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e60 tx=0x7f034c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa4816033c4eb3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0351400640 1 -- 172.21.15.42:0/791462463 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c007550 con 0x7f03540add30 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0351400640 1 -- 172.21.15.42:0/791462463 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c02d050 con 0x7f03540add30 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0351400640 1 -- 172.21.15.42:0/791462463 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c007900 con 0x7f03540add30 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 -- 172.21.15.42:0/791462463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 msgr2=0x7f035415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f035415b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e60 tx=0x7f034c009780 comp rx=0 tx=0).stop 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 -- 172.21.15.42:0/791462463 shutdown_connections 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f035415b0a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 --2- 172.21.15.42:0/791462463 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ca050 0x7f0354156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 -- 172.21.15.42:0/791462463 >> 172.21.15.42:0/791462463 conn(0x7f0354066e60 msgr2=0x7f0354067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 -- 172.21.15.42:0/791462463 shutdown_connections 2024-08-17T02:30:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.986+0000 7f0358a00640 1 -- 172.21.15.42:0/791462463 wait complete. 2024-08-17T02:30:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.988+0000 7f0358a00640 1 Processor -- start 2024-08-17T02:30:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.988+0000 7f0358a00640 1 -- start start 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0358a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ad960 0x7f035414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0358a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f0354157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0358a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03540ca050 0x7f0354152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0358a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035414e290 con 0x7f03540add30 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0358a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035414e500 con 0x7f03540ca050 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0358a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035414e7e0 con 0x7f03540ad960 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f034be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f0354157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f034be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f0354157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55696/0 (socket says 172.21.15.42:55696) 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f034be00640 1 -- 172.21.15.42:0/1775448495 learned_addr learned my addr 172.21.15.42:0/1775448495 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0351e00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ad960 0x7f035414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.989+0000 7f0352800640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03540ca050 0x7f0354152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f034be00640 1 -- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ad960 msgr2=0x7f035414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f034be00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ad960 0x7f035414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f034be00640 1 -- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03540ca050 msgr2=0x7f0354152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f034be00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03540ca050 0x7f0354152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:39.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f034be00640 1 -- 172.21.15.42:0/1775448495 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c009a20 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f034be00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f0354157140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f033c00c880 tx=0x7f033c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00ce10 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c007830 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035414eac0 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c007bf0 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.990+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0354157680 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.991+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035414efe0 con 0x7f03540add30 2024-08-17T02:30:39.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.992+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f033c0113f0 con 0x7f03540add30 2024-08-17T02:30:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.994+0000 7f0349600640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0330065180 0x7f0330067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.994+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f033c082350 con 0x7f03540add30 2024-08-17T02:30:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.994+0000 7f0351e00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0330065180 0x7f0330067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:39.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.995+0000 7f0351e00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0330065180 0x7f0330067630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0354156a60 tx=0x7f0344007b00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:39.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:39.998+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f035414efe0 con 0x7f03540add30 2024-08-17T02:30:40.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.178+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.data", "var": "pg_num"} v 0) v1 -- 0x7f035414efe0 con 0x7f03540add30 2024-08-17T02:30:40.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.178+0000 7f0349600640 1 -- 172.21.15.42:0/1775448495 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000001039443.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f035414efe0 con 0x7f03540add30 2024-08-17T02:30:40.180 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0330065180 msgr2=0x7f0330067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0330065180 0x7f0330067630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0354156a60 tx=0x7f0344007b00 comp rx=0 tx=0).stop 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 msgr2=0x7f0354157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f0354157140 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f033c00c880 tx=0x7f033c008040 comp rx=0 tx=0).stop 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 shutdown_connections 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0330065180 0x7f0330067630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03540ca050 0x7f0354152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03540add30 0x7f0354157140 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 --2- 172.21.15.42:0/1775448495 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f03540ad960 0x7f035414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 >> 172.21.15.42:0/1775448495 conn(0x7f0354066e60 msgr2=0x7f035406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 shutdown_connections 2024-08-17T02:30:40.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.180+0000 7f0358a00640 1 -- 172.21.15.42:0/1775448495 wait complete. 2024-08-17T02:30:40.197 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:40.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.348+0000 7fb1f6000640 1 Processor -- start 2024-08-17T02:30:40.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.348+0000 7fb1f6000640 1 -- start start 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.349+0000 7fb1f6000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1f015a490 0x7fb1f00ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.349+0000 7fb1f6000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f015b6b0 con 0x7fb1f0158c60 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.349+0000 7fb1f6000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f015aac0 con 0x7fb1f00b1920 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.349+0000 7fb1f6000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f00b0540 con 0x7fb1f015a490 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.349+0000 7fb1f4c00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb1f0158c60 0x7fb1f0159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38648/0 (socket says 172.21.15.42:38648) 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.349+0000 7fb1f4c00640 1 -- 172.21.15.42:0/4071163174 learned_addr learned my addr 172.21.15.42:0/4071163174 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1efe00640 1 --2- 172.21.15.42:0/4071163174 >> v2:172.21.15.62:3300/0 conn(0x7fb1f015a490 0x7fb1f00ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1ef400640 1 -- 172.21.15.42:0/4071163174 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297046495 0 0) 0x7fb1f015b6b0 con 0x7fb1f0158c60 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1ef400640 1 -- 172.21.15.42:0/4071163174 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d80034e0 con 0x7fb1f0158c60 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1ef400640 1 -- 172.21.15.42:0/4071163174 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4020892329 0 0) 0x7fb1d80034e0 con 0x7fb1f0158c60 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1efe00640 1 -- 172.21.15.42:0/4071163174 >> v1:172.21.15.62:6789/0 conn(0x7fb1f00b1920 legacy=0x7fb1f00b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1efe00640 1 -- 172.21.15.42:0/4071163174 >> v1:172.21.15.42:6789/0 conn(0x7fb1f0158c60 legacy=0x7fb1f0159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.350+0000 7fb1efe00640 1 -- 172.21.15.42:0/4071163174 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f015ad80 con 0x7fb1f015a490 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.351+0000 7fb1efe00640 1 --2- 172.21.15.42:0/4071163174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00ca8b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009850 tx=0x7fb1dc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c506b022e013ec0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.351+0000 7fb1ef400640 1 -- 172.21.15.42:0/4071163174 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4001470 con 0x7fb1f015a490 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.351+0000 7fb1ef400640 1 -- 172.21.15.42:0/4071163174 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc02aa50 con 0x7fb1f015a490 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1ef400640 1 -- 172.21.15.42:0/4071163174 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc02adf0 con 0x7fb1f015a490 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 -- 172.21.15.42:0/4071163174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 msgr2=0x7fb1f00ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 --2- 172.21.15.42:0/4071163174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00ca8b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009850 tx=0x7fb1dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 -- 172.21.15.42:0/4071163174 shutdown_connections 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 --2- 172.21.15.42:0/4071163174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00ca8b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 -- 172.21.15.42:0/4071163174 >> 172.21.15.42:0/4071163174 conn(0x7fb1f006e590 msgr2=0x7fb1f006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 -- 172.21.15.42:0/4071163174 shutdown_connections 2024-08-17T02:30:40.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.352+0000 7fb1f6000640 1 -- 172.21.15.42:0/4071163174 wait complete. 2024-08-17T02:30:40.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.354+0000 7fb1f6000640 1 Processor -- start 2024-08-17T02:30:40.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.354+0000 7fb1f6000640 1 -- start start 2024-08-17T02:30:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.354+0000 7fb1f6000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f00b1920 0x7fb1f016bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.354+0000 7fb1f6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 0x7fb1f00c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1f6000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1f6000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00c8fe0 con 0x7fb1f0158c60 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1f6000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00c8350 con 0x7fb1f015a490 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1f6000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f00c7740 con 0x7fb1f00b1920 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 0x7fb1f00c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 0x7fb1f00c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55712/0 (socket says 172.21.15.42:55712) 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 -- 172.21.15.42:0/1593137791 learned_addr learned my addr 172.21.15.42:0/1593137791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1f4c00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f00b1920 0x7fb1f016bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1f5600640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 -- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f00b1920 msgr2=0x7fb1f016bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f00b1920 0x7fb1f016bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 -- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 msgr2=0x7fb1f00c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.355+0000 7fb1efe00640 1 -- 172.21.15.42:0/1593137791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc009390 con 0x7fb1f0158c60 2024-08-17T02:30:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.356+0000 7fb1efe00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 0x7fb1f00c6bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009850 tx=0x7fb1dc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.356+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc000c40 con 0x7fb1f0158c60 2024-08-17T02:30:40.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.356+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc03b610 con 0x7fb1f0158c60 2024-08-17T02:30:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.356+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc03b9d0 con 0x7fb1f0158c60 2024-08-17T02:30:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.356+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f00c7a20 con 0x7fb1f0158c60 2024-08-17T02:30:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.356+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f00c7fe0 con 0x7fb1f0158c60 2024-08-17T02:30:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.357+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f0070720 con 0x7fb1f0158c60 2024-08-17T02:30:40.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.358+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb1dc043030 con 0x7fb1f0158c60 2024-08-17T02:30:40.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.359+0000 7fb1e3e00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb1d0065150 0x7fb1d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.359+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fb1dc041070 con 0x7fb1f0158c60 2024-08-17T02:30:40.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.359+0000 7fb1f4c00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb1d0065150 0x7fb1d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.360+0000 7fb1f4c00640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb1d0065150 0x7fb1d0067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4001ed0 tx=0x7fb1e40011c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.363+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb1dc0708a0 con 0x7fb1f0158c60 2024-08-17T02:30:40.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.583+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1f00ccc90 con 0x7fb1f0158c60 2024-08-17T02:30:40.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.584+0000 7fb1e3e00640 1 -- 172.21.15.42:0/1593137791 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4612 (secure 0 0 0) 0x7fb1dc073ec0 con 0x7fb1f0158c60 2024-08-17T02:30:40.586 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6836/2058513191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2058513191},{"type":"v1","addr":"172.21.15.42:6836","nonce":2058513191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:40.587 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2024-08-17T02:30:40.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb1d0065150 msgr2=0x7fb1d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb1d0065150 0x7fb1d0067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4001ed0 tx=0x7fb1e40011c0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 msgr2=0x7fb1f00c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 0x7fb1f00c6bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009850 tx=0x7fb1dc032000 comp rx=0 tx=0).stop 2024-08-17T02:30:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 shutdown_connections 2024-08-17T02:30:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb1d0065150 0x7fb1d0067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1f015a490 0x7fb1f00c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f0158c60 0x7fb1f00c6bc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 --2- 172.21.15.42:0/1593137791 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb1f00b1920 0x7fb1f016bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.586+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 >> 172.21.15.42:0/1593137791 conn(0x7fb1f006e590 msgr2=0x7fb1f00caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.587+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 shutdown_connections 2024-08-17T02:30:40.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.587+0000 7fb1f6000640 1 -- 172.21.15.42:0/1593137791 wait complete. 2024-08-17T02:30:40.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:40.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.755+0000 7f749be00640 1 Processor -- start 2024-08-17T02:30:40.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.755+0000 7f749be00640 1 -- start start 2024-08-17T02:30:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749be00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f749c0b0e30 0x7f749c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c156f90 0x7f749c0cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749be00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749c06d7c0 con 0x7f749c15a590 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749be00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c0cb5b0 con 0x7f749c0b0e30 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749be00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15ab30 con 0x7f749c156f90 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749b400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f749c15a590 0x7f749c13fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:38654/0 (socket says 172.21.15.42:38654) 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749b400640 1 -- 172.21.15.42:0/1924078479 learned_addr learned my addr 172.21.15.42:0/1924078479 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f749aa00640 1 --2- 172.21.15.42:0/1924078479 >> v2:172.21.15.62:3300/0 conn(0x7f749c0b0e30 0x7f749c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.756+0000 7f7492000640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c156f90 0x7f749c0cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f749a000640 1 -- 172.21.15.42:0/1924078479 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459903723 0 0) 0x7f749c06d7c0 con 0x7f749c15a590 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f749a000640 1 -- 172.21.15.42:0/1924078479 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74800034e0 con 0x7f749c15a590 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f749aa00640 1 -- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c156f90 msgr2=0x7f749c0cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f749aa00640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c156f90 0x7f749c0cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f749aa00640 1 -- 172.21.15.42:0/1924078479 >> v1:172.21.15.42:6789/0 conn(0x7f749c15a590 legacy=0x7f749c13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f749aa00640 1 -- 172.21.15.42:0/1924078479 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c15ae10 con 0x7f749c0b0e30 2024-08-17T02:30:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.757+0000 7f7492000640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c156f90 0x7f749c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.758+0000 7f749aa00640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c0b0e30 0x7f749c0b1200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f748c009850 tx=0x7f748c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60cbe25c4fc6f32 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.758+0000 7f749a000640 1 -- 172.21.15.42:0/1924078479 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c02ad90 con 0x7f749c0b0e30 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.758+0000 7f749a000640 1 -- 172.21.15.42:0/1924078479 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c032440 con 0x7f749c0b0e30 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.758+0000 7f749a000640 1 -- 172.21.15.42:0/1924078479 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c032820 con 0x7f749c0b0e30 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 -- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c0b0e30 msgr2=0x7f749c0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c0b0e30 0x7f749c0b1200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f748c009850 tx=0x7f748c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 -- 172.21.15.42:0/1924078479 shutdown_connections 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c156f90 0x7f749c0cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 --2- 172.21.15.42:0/1924078479 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c0b0e30 0x7f749c0b1200 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 -- 172.21.15.42:0/1924078479 >> 172.21.15.42:0/1924078479 conn(0x7f749c062af0 msgr2=0x7f749c062ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 -- 172.21.15.42:0/1924078479 shutdown_connections 2024-08-17T02:30:40.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.759+0000 7f749be00640 1 -- 172.21.15.42:0/1924078479 wait complete. 2024-08-17T02:30:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.760+0000 7f749be00640 1 Processor -- start 2024-08-17T02:30:40.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 -- start start 2024-08-17T02:30:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 0x7f749c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c156f90 0x7f749c14dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c15a590 0x7f749c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15be20 con 0x7f749c0b0e30 2024-08-17T02:30:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15c100 con 0x7f749c156f90 2024-08-17T02:30:40.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.761+0000 7f749be00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c15c3e0 con 0x7f749c15a590 2024-08-17T02:30:40.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 0x7f749c15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 0x7f749c15b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55720/0 (socket says 172.21.15.42:55720) 2024-08-17T02:30:40.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 -- 172.21.15.42:0/1640864807 learned_addr learned my addr 172.21.15.42:0/1640864807 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 -- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c15a590 msgr2=0x7f749c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c15a590 0x7f749c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f7492000640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c156f90 0x7f749c14dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 -- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c156f90 msgr2=0x7f749c14dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c156f90 0x7f749c14dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 -- 172.21.15.42:0/1640864807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484009390 con 0x7f749c0b0e30 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f7492000640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c156f90 0x7f749c14dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.762+0000 7f749aa00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 0x7f749c15b5d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f748c009360 tx=0x7f748c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.763+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c031c20 con 0x7f749c0b0e30 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.763+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c031da0 con 0x7f749c0b0e30 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.763+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c03d670 con 0x7f749c0b0e30 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.763+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c009390 con 0x7f749c0b0e30 2024-08-17T02:30:40.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.763+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c15c9a0 con 0x7f749c0b0e30 2024-08-17T02:30:40.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.764+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c06a470 con 0x7f749c0b0e30 2024-08-17T02:30:40.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.765+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f748c039040 con 0x7f749c0b0e30 2024-08-17T02:30:40.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.766+0000 7f7492a00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7478065150 0x7f7478067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:40.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.766+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f748c0a2320 con 0x7f749c0b0e30 2024-08-17T02:30:40.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.766+0000 7f7492000640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7478065150 0x7f7478067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:40.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.767+0000 7f7492000640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7478065150 0x7f7478067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7484009360 tx=0x7f7484008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:40.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.770+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f748c070360 con 0x7f749c0b0e30 2024-08-17T02:30:40.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.953+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f749c13bd20 con 0x7f749c0b0e30 2024-08-17T02:30:40.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.954+0000 7f7492a00640 1 -- 172.21.15.42:0/1640864807 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15464 (secure 0 0 0) 0x7f748c073980 con 0x7f749c0b0e30 2024-08-17T02:30:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:40.956 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":40,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:30:38.681039+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6836/3869657839":"2024-08-18T02:30:35.671511+0000","172.21.15.42:6834/3869657839":"2024-08-18T02:30:35.671511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7478065150 msgr2=0x7f7478067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7478065150 0x7f7478067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7484009360 tx=0x7f7484008040 comp rx=0 tx=0).stop 2024-08-17T02:30:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 msgr2=0x7f749c15b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 0x7f749c15b5d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f748c009360 tx=0x7f748c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 shutdown_connections 2024-08-17T02:30:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7478065150 0x7f7478067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f749c15a590 0x7f749c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f749c156f90 0x7f749c14dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 --2- 172.21.15.42:0/1640864807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f749c0b0e30 0x7f749c15b5d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 >> 172.21.15.42:0/1640864807 conn(0x7f749c062af0 msgr2=0x7f749c0afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 shutdown_connections 2024-08-17T02:30:40.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:40.956+0000 7f749be00640 1 -- 172.21.15.42:0/1640864807 wait complete. 2024-08-17T02:30:40.973 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000001039443 and related pools 2024-08-17T02:30:40.973 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.122+0000 7fc223000640 1 Processor -- start 2024-08-17T02:30:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.123+0000 7fc223000640 1 -- start start 2024-08-17T02:30:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc223000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc21c0cd550 0x7fc21c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc223000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c15c9d0 con 0x7fc21c159cd0 2024-08-17T02:30:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc223000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c15a200 con 0x7fc21c069840 2024-08-17T02:30:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc223000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0cbfe0 con 0x7fc21c0cd550 2024-08-17T02:30:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc221200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc21c0cd550 0x7fc21c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc222600640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc21c159cd0 0x7fc21c0ca340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43700/0 (socket says 172.21.15.42:43700) 2024-08-17T02:30:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.124+0000 7fc222600640 1 -- 172.21.15.42:0/216795053 learned_addr learned my addr 172.21.15.42:0/216795053 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.125+0000 7fc221200640 1 -- 172.21.15.42:0/216795053 >> v1:172.21.15.62:6789/0 conn(0x7fc21c069840 legacy=0x7fc21c0cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.125+0000 7fc221200640 1 -- 172.21.15.42:0/216795053 >> v1:172.21.15.42:6789/0 conn(0x7fc21c159cd0 legacy=0x7fc21c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.125+0000 7fc221200640 1 -- 172.21.15.42:0/216795053 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0b0830 con 0x7fc21c0cd550 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.125+0000 7fc21be00640 1 -- 172.21.15.42:0/216795053 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374564191 0 0) 0x7fc21c15c9d0 con 0x7fc21c159cd0 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.126+0000 7fc221200640 1 --2- 172.21.15.42:0/216795053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c0cd550 0x7fc21c15ce60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc208009850 tx=0x7fc2080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cd212bbb48231 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.126+0000 7fc21be00640 1 -- 172.21.15.42:0/216795053 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20802ae20 con 0x7fc21c0cd550 2024-08-17T02:30:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.126+0000 7fc21be00640 1 -- 172.21.15.42:0/216795053 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208032440 con 0x7fc21c0cd550 2024-08-17T02:30:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.126+0000 7fc21be00640 1 -- 172.21.15.42:0/216795053 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2080327e0 con 0x7fc21c0cd550 2024-08-17T02:30:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.126+0000 7fc223000640 1 -- 172.21.15.42:0/216795053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c0cd550 msgr2=0x7fc21c15ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.126+0000 7fc223000640 1 --2- 172.21.15.42:0/216795053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c0cd550 0x7fc21c15ce60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc208009850 tx=0x7fc2080090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.127+0000 7fc223000640 1 -- 172.21.15.42:0/216795053 shutdown_connections 2024-08-17T02:30:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.127+0000 7fc223000640 1 --2- 172.21.15.42:0/216795053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c0cd550 0x7fc21c15ce60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.127+0000 7fc223000640 1 -- 172.21.15.42:0/216795053 >> 172.21.15.42:0/216795053 conn(0x7fc21c066e60 msgr2=0x7fc21c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.127+0000 7fc223000640 1 -- 172.21.15.42:0/216795053 shutdown_connections 2024-08-17T02:30:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.127+0000 7fc223000640 1 -- 172.21.15.42:0/216795053 wait complete. 2024-08-17T02:30:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.128+0000 7fc223000640 1 Processor -- start 2024-08-17T02:30:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.128+0000 7fc223000640 1 -- start start 2024-08-17T02:30:41.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc223000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc21c069840 0x7fc21c141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc223000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 0x7fc21c140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc223000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc21c155dd0 0x7fc21c15f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc223000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c15d810 con 0x7fc21c159cd0 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc223000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c15dab0 con 0x7fc21c069840 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc223000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c15dd90 con 0x7fc21c155dd0 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc221200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 0x7fc21c140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc221200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 0x7fc21c140d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47880/0 (socket says 172.21.15.42:47880) 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc221200640 1 -- 172.21.15.42:0/202567181 learned_addr learned my addr 172.21.15.42:0/202567181 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc221c00640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc21c069840 0x7fc21c141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.129+0000 7fc222600640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc21c155dd0 0x7fc21c15f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc221200640 1 -- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc21c155dd0 msgr2=0x7fc21c15f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc221200640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc21c155dd0 0x7fc21c15f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc221200640 1 -- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc21c069840 msgr2=0x7fc21c141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc221200640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc21c069840 0x7fc21c141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc221200640 1 -- 172.21.15.42:0/202567181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc208009390 con 0x7fc21c159cd0 2024-08-17T02:30:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc221200640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 0x7fc21c140d70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc208009850 tx=0x7fc208032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208031b30 con 0x7fc21c159cd0 2024-08-17T02:30:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc208031cd0 con 0x7fc21c159cd0 2024-08-17T02:30:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20803d670 con 0x7fc21c159cd0 2024-08-17T02:30:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c15e070 con 0x7fc21c159cd0 2024-08-17T02:30:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.130+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c141bd0 con 0x7fc21c159cd0 2024-08-17T02:30:41.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.131+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c070720 con 0x7fc21c159cd0 2024-08-17T02:30:41.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.132+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc208039040 con 0x7fc21c159cd0 2024-08-17T02:30:41.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.133+0000 7fc218c00640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1fc065150 0x7fc1fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.133+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc2080a2300 con 0x7fc21c159cd0 2024-08-17T02:30:41.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.133+0000 7fc221c00640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1fc065150 0x7fc1fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.134+0000 7fc221c00640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1fc065150 0x7fc1fc067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc2100037c0 tx=0x7fc210009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.137+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc208070360 con 0x7fc21c159cd0 2024-08-17T02:30:41.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.357+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc21c09b470 con 0x7fc21c159cd0 2024-08-17T02:30:41.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.358+0000 7fc218c00640 1 -- 172.21.15.42:0/202567181 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4612 (secure 0 0 0) 0x7fc208073980 con 0x7fc21c159cd0 2024-08-17T02:30:41.359 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:41.359 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6836/2058513191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2058513191},{"type":"v1","addr":"172.21.15.42:6836","nonce":2058513191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:41.359 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2024-08-17T02:30:41.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1fc065150 msgr2=0x7fc1fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1fc065150 0x7fc1fc067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc2100037c0 tx=0x7fc210009040 comp rx=0 tx=0).stop 2024-08-17T02:30:41.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 msgr2=0x7fc21c140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 0x7fc21c140d70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc208009850 tx=0x7fc208032000 comp rx=0 tx=0).stop 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 shutdown_connections 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc1fc065150 0x7fc1fc067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc21c155dd0 0x7fc21c15f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc21c159cd0 0x7fc21c140d70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 --2- 172.21.15.42:0/202567181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc21c069840 0x7fc21c141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 >> 172.21.15.42:0/202567181 conn(0x7fc21c066e60 msgr2=0x7fc21c0ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 shutdown_connections 2024-08-17T02:30:41.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.360+0000 7fc223000640 1 -- 172.21.15.42:0/202567181 wait complete. 2024-08-17T02:30:41.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.526+0000 7fc6cdc00640 1 Processor -- start 2024-08-17T02:30:41.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.527+0000 7fc6cdc00640 1 -- start start 2024-08-17T02:30:41.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6cdc00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc6c8153070 0x7fc6c815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6cdc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6c80cc5a0 0x7fc6c80cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6cdc00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80ce830 con 0x7fc6c8159dd0 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6cdc00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80cdca0 con 0x7fc6c8153070 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6cdc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80cdf40 con 0x7fc6c80cc5a0 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6c7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc6c8153070 0x7fc6c815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6c7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc6c8153070 0x7fc6c815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47892/0 (socket says 172.21.15.42:47892) 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6c7e00640 1 -- 172.21.15.42:0/644757659 learned_addr learned my addr 172.21.15.42:0/644757659 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6cd200640 1 --2- 172.21.15.42:0/644757659 >> v2:172.21.15.62:3300/0 conn(0x7fc6c80cc5a0 0x7fc6c80cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6c7e00640 1 -- 172.21.15.42:0/644757659 >> v2:172.21.15.62:3300/0 conn(0x7fc6c80cc5a0 msgr2=0x7fc6c80cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6c7e00640 1 --2- 172.21.15.42:0/644757659 >> v2:172.21.15.62:3300/0 conn(0x7fc6c80cc5a0 0x7fc6c80cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.528+0000 7fc6c7e00640 1 -- 172.21.15.42:0/644757659 >> v1:172.21.15.62:6789/0 conn(0x7fc6c8159dd0 legacy=0x7fc6c80cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:41.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.529+0000 7fc6c7e00640 1 -- 172.21.15.42:0/644757659 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80ccf40 con 0x7fc6c8153070 2024-08-17T02:30:41.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.529+0000 7fc6cd200640 1 --2- 172.21.15.42:0/644757659 >> v2:172.21.15.62:3300/0 conn(0x7fc6c80cc5a0 0x7fc6c80cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.529+0000 7fc6c7e00640 1 --2- 172.21.15.42:0/644757659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8153070 0x7fc6c815a2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80cd530 tx=0x7fc6b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b7fd89cfeea5cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6c6a00640 1 -- 172.21.15.42:0/644757659 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b802ad50 con 0x7fc6c8153070 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6c6a00640 1 -- 172.21.15.42:0/644757659 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8032440 con 0x7fc6c8153070 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6c6a00640 1 -- 172.21.15.42:0/644757659 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8032820 con 0x7fc6c8153070 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6cdc00640 1 -- 172.21.15.42:0/644757659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8153070 msgr2=0x7fc6c815a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/644757659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8153070 0x7fc6c815a2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc6c80cd530 tx=0x7fc6b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6cdc00640 1 -- 172.21.15.42:0/644757659 shutdown_connections 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/644757659 >> v2:172.21.15.62:3300/0 conn(0x7fc6c80cc5a0 0x7fc6c80cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/644757659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8153070 0x7fc6c815a2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.530+0000 7fc6cdc00640 1 -- 172.21.15.42:0/644757659 >> 172.21.15.42:0/644757659 conn(0x7fc6c8087a80 msgr2=0x7fc6c806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.531+0000 7fc6cdc00640 1 -- 172.21.15.42:0/644757659 shutdown_connections 2024-08-17T02:30:41.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.531+0000 7fc6cdc00640 1 -- 172.21.15.42:0/644757659 wait complete. 2024-08-17T02:30:41.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.532+0000 7fc6cdc00640 1 Processor -- start 2024-08-17T02:30:41.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.532+0000 7fc6cdc00640 1 -- start start 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cdc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c80cc5a0 0x7fc6c81521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cdc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8153070 0x7fc6c81699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cdc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 0x7fc6c8155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cdc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8169530 con 0x7fc6c8159dd0 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cdc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8156730 con 0x7fc6c8153070 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cdc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8156a10 con 0x7fc6c80cc5a0 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cd200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 0x7fc6c8155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cd200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 0x7fc6c8155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47902/0 (socket says 172.21.15.42:47902) 2024-08-17T02:30:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6cd200640 1 -- 172.21.15.42:0/702283261 learned_addr learned my addr 172.21.15.42:0/702283261 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6c7e00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c80cc5a0 0x7fc6c81521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.533+0000 7fc6c7400640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8153070 0x7fc6c81699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cd200640 1 -- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c80cc5a0 msgr2=0x7fc6c81521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cd200640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c80cc5a0 0x7fc6c81521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cd200640 1 -- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8153070 msgr2=0x7fc6c81699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cd200640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8153070 0x7fc6c81699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cd200640 1 -- 172.21.15.42:0/702283261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8009450 con 0x7fc6c8159dd0 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6c7400640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8153070 0x7fc6c81699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cd200640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 0x7fc6c8155c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000a380 tx=0x7fc6c0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000d650 con 0x7fc6c8159dd0 2024-08-17T02:30:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000d7b0 con 0x7fc6c8159dd0 2024-08-17T02:30:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c81691c0 con 0x7fc6c8159dd0 2024-08-17T02:30:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000db70 con 0x7fc6c8159dd0 2024-08-17T02:30:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.534+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c815da70 con 0x7fc6c8159dd0 2024-08-17T02:30:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.535+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c81696e0 con 0x7fc6c8159dd0 2024-08-17T02:30:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.536+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc6c001e3b0 con 0x7fc6c8159dd0 2024-08-17T02:30:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.537+0000 7fc6bf400640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6a8065180 0x7fc6a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.537+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fc6c0082ed0 con 0x7fc6c8159dd0 2024-08-17T02:30:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.537+0000 7fc6c7e00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6a8065180 0x7fc6a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.538+0000 7fc6c7e00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6a8065180 0x7fc6a8067630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8034000 tx=0x7fc6b8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.541+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6c0050fe0 con 0x7fc6c8159dd0 2024-08-17T02:30:41.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.761+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6c8070720 con 0x7fc6c8159dd0 2024-08-17T02:30:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.762+0000 7fc6bf400640 1 -- 172.21.15.42:0/702283261 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4612 (secure 0 0 0) 0x7fc6c001a090 con 0x7fc6c8159dd0 2024-08-17T02:30:41.763 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:41.763 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6836/2058513191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2058513191},{"type":"v1","addr":"172.21.15.42:6836","nonce":2058513191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.007693+0000","modified":"2024-08-17T02:28:30.010014+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4739":{"gid":4739,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":7,"addr":"172.21.15.62:6835/4011881108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":4011881108},{"type":"v1","addr":"172.21.15.62:6835","nonce":4011881108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000001039443","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2024-08-17T02:30:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6a8065180 msgr2=0x7fc6a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6a8065180 0x7fc6a8067630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8034000 tx=0x7fc6b8032000 comp rx=0 tx=0).stop 2024-08-17T02:30:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 msgr2=0x7fc6c8155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 0x7fc6c8155c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000a380 tx=0x7fc6c0007900 comp rx=0 tx=0).stop 2024-08-17T02:30:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 shutdown_connections 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fc6a8065180 0x7fc6a8067630 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c8159dd0 0x7fc6c8155c50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6c8153070 0x7fc6c81699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 --2- 172.21.15.42:0/702283261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6c80cc5a0 0x7fc6c81521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 >> 172.21.15.42:0/702283261 conn(0x7fc6c8087a80 msgr2=0x7fc6c8159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 shutdown_connections 2024-08-17T02:30:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.764+0000 7fc6cdc00640 1 -- 172.21.15.42:0/702283261 wait complete. 2024-08-17T02:30:41.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:41.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.930+0000 7f3913000640 1 Processor -- start 2024-08-17T02:30:41.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.931+0000 7f3913000640 1 -- start start 2024-08-17T02:30:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3913000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f390c0c8290 0x7f390c0ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3913000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f390c0aca30 0x7f390c067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3913000640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0aa5a0 con 0x7f390c158af0 2024-08-17T02:30:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3913000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0abde0 con 0x7f390c0c8290 2024-08-17T02:30:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3913000640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0ace00 con 0x7f390c0aca30 2024-08-17T02:30:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3911200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f390c0c8290 0x7f390c0ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3911200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f390c0c8290 0x7f390c0ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47918/0 (socket says 172.21.15.42:47918) 2024-08-17T02:30:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3911200640 1 -- 172.21.15.42:0/1946801446 learned_addr learned my addr 172.21.15.42:0/1946801446 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.932+0000 7f3912600640 1 --2- 172.21.15.42:0/1946801446 >> v2:172.21.15.62:3300/0 conn(0x7f390c0aca30 0x7f390c067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.933+0000 7f3911200640 1 -- 172.21.15.42:0/1946801446 >> v2:172.21.15.62:3300/0 conn(0x7f390c0aca30 msgr2=0x7f390c067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:41.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.933+0000 7f3911200640 1 --2- 172.21.15.42:0/1946801446 >> v2:172.21.15.62:3300/0 conn(0x7f390c0aca30 0x7f390c067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.933+0000 7f3911200640 1 -- 172.21.15.42:0/1946801446 >> v1:172.21.15.62:6789/0 conn(0x7f390c158af0 legacy=0x7f390c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.933+0000 7f3911200640 1 -- 172.21.15.42:0/1946801446 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0a9c70 con 0x7f390c0c8290 2024-08-17T02:30:41.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.934+0000 7f3911200640 1 --2- 172.21.15.42:0/1946801446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0ac4f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f390c0c8710 tx=0x7f38f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d256659f049566 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.934+0000 7f390be00640 1 -- 172.21.15.42:0/1946801446 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f802ae80 con 0x7f390c0c8290 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.934+0000 7f390be00640 1 -- 172.21.15.42:0/1946801446 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f8032440 con 0x7f390c0c8290 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.934+0000 7f390be00640 1 -- 172.21.15.42:0/1946801446 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8032800 con 0x7f390c0c8290 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.934+0000 7f3913000640 1 -- 172.21.15.42:0/1946801446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 msgr2=0x7f390c0ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.934+0000 7f3913000640 1 --2- 172.21.15.42:0/1946801446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0ac4f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f390c0c8710 tx=0x7f38f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.935+0000 7f3913000640 1 -- 172.21.15.42:0/1946801446 shutdown_connections 2024-08-17T02:30:41.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.935+0000 7f3913000640 1 --2- 172.21.15.42:0/1946801446 >> v2:172.21.15.62:3300/0 conn(0x7f390c0aca30 0x7f390c067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.935+0000 7f3913000640 1 --2- 172.21.15.42:0/1946801446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0ac4f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.935+0000 7f3913000640 1 -- 172.21.15.42:0/1946801446 >> 172.21.15.42:0/1946801446 conn(0x7f390c0cc060 msgr2=0x7f390c0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:41.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.935+0000 7f3913000640 1 -- 172.21.15.42:0/1946801446 shutdown_connections 2024-08-17T02:30:41.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.935+0000 7f3913000640 1 -- 172.21.15.42:0/1946801446 wait complete. 2024-08-17T02:30:41.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.936+0000 7f3913000640 1 Processor -- start 2024-08-17T02:30:41.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.936+0000 7f3913000640 1 -- start start 2024-08-17T02:30:41.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.937+0000 7f3913000640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f390c0aca30 0x7f390c0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.937+0000 7f3913000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.937+0000 7f3913000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f390c158af0 0x7f390c169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.937+0000 7f3913000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c169eb0 con 0x7f390c0c8290 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.937+0000 7f3913000640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0c4d60 con 0x7f390c158af0 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.937+0000 7f3913000640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0c4150 con 0x7f390c0aca30 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3912600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f390c158af0 0x7f390c169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47920/0 (socket says 172.21.15.42:47920) 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 -- 172.21.15.42:0/1165929093 learned_addr learned my addr 172.21.15.42:0/1165929093 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911c00640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f390c0aca30 0x7f390c0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 -- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f390c0aca30 msgr2=0x7f390c0c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f390c0aca30 0x7f390c0c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 -- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f390c158af0 msgr2=0x7f390c169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:41.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f390c158af0 0x7f390c169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:41.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 -- 172.21.15.42:0/1165929093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8009450 con 0x7f390c0c8290 2024-08-17T02:30:41.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.938+0000 7f3911200640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0c51f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009210 tx=0x7f38f8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.939+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8000d10 con 0x7f390c0c8290 2024-08-17T02:30:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.939+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f8031de0 con 0x7f390c0c8290 2024-08-17T02:30:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.939+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c0c4430 con 0x7f390c0c8290 2024-08-17T02:30:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.939+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f803d690 con 0x7f390c0c8290 2024-08-17T02:30:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.939+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0c49f0 con 0x7f390c0c8290 2024-08-17T02:30:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.940+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c0c4ef0 con 0x7f390c0c8290 2024-08-17T02:30:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.941+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38f8039040 con 0x7f390c0c8290 2024-08-17T02:30:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.941+0000 7f3908c00640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f38ec065150 0x7f38ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.942+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f38f80a2750 con 0x7f390c0c8290 2024-08-17T02:30:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.942+0000 7f3911c00640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f38ec065150 0x7f38ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.942+0000 7f3911c00640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f38ec065150 0x7f38ec067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3900007fd0 tx=0x7f3900007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:41.946+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38f80707a0 con 0x7f390c0c8290 2024-08-17T02:30:42.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.128+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f390c070720 con 0x7f390c0c8290 2024-08-17T02:30:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.129+0000 7f3908c00640 1 -- 172.21.15.42:0/1165929093 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15464 (secure 0 0 0) 0x7f38f8073dc0 con 0x7f390c0c8290 2024-08-17T02:30:42.131 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:42.131 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":40,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:30:38.681039+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000001039443.meta","create_time":"2024-08-17T02:28:26.181709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000001039443"}}},{"pool":7,"pool_name":"cephfs.volume_0000000001039443.data","create_time":"2024-08-17T02:28:27.046060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000001039443"}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6836/3869657839":"2024-08-18T02:30:35.671511+0000","172.21.15.42:6834/3869657839":"2024-08-18T02:30:35.671511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.131+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f38ec065150 msgr2=0x7f38ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.131+0000 7f3913000640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f38ec065150 0x7f38ec067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3900007fd0 tx=0x7f3900007e30 comp rx=0 tx=0).stop 2024-08-17T02:30:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.131+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 msgr2=0x7f390c0c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.131+0000 7f3913000640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0c51f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009210 tx=0x7f38f8032000 comp rx=0 tx=0).stop 2024-08-17T02:30:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 shutdown_connections 2024-08-17T02:30:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f38ec065150 0x7f38ec067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f390c158af0 0x7f390c169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f390c0c8290 0x7f390c0c51f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 --2- 172.21.15.42:0/1165929093 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f390c0aca30 0x7f390c0c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 >> 172.21.15.42:0/1165929093 conn(0x7f390c0cc060 msgr2=0x7f390c0ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 shutdown_connections 2024-08-17T02:30:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.132+0000 7f3913000640 1 -- 172.21.15.42:0/1165929093 wait complete. 2024-08-17T02:30:42.148 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000001039443 2024-08-17T02:30:42.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.299+0000 7f8408800640 1 Processor -- start 2024-08-17T02:30:42.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.299+0000 7f8408800640 1 -- start start 2024-08-17T02:30:42.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8408800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f84000ad960 0x7f840015b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8408800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f8400156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8408800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840015b5e0 con 0x7f84000ca050 2024-08-17T02:30:42.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8408800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000cb160 con 0x7f84000ad960 2024-08-17T02:30:42.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8408800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000b0d10 con 0x7f84000add30 2024-08-17T02:30:42.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8405e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f84000ad960 0x7f840015b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8405400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f84000ca050 0x7f8400156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43714/0 (socket says 172.21.15.42:43714) 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.300+0000 7f8405400640 1 -- 172.21.15.42:0/478327052 learned_addr learned my addr 172.21.15.42:0/478327052 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8406800640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f8400156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8405e00640 1 -- 172.21.15.42:0/478327052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 msgr2=0x7f8400156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8405e00640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f8400156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8405e00640 1 -- 172.21.15.42:0/478327052 >> v1:172.21.15.42:6789/0 conn(0x7f84000ca050 legacy=0x7f8400156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8404a00640 1 -- 172.21.15.42:0/478327052 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047050800 0 0) 0x7f83f0001110 con 0x7f84000ca050 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8405e00640 1 -- 172.21.15.42:0/478327052 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000ca550 con 0x7f84000ad960 2024-08-17T02:30:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.301+0000 7f8406800640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f8400156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.302+0000 7f8405e00640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ad960 0x7f840015b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009850 tx=0x7f83f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0db2ec3c84c9342 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.302+0000 7f8404a00640 1 -- 172.21.15.42:0/478327052 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f402ae10 con 0x7f84000ad960 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.302+0000 7f8404a00640 1 -- 172.21.15.42:0/478327052 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4032440 con 0x7f84000ad960 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.302+0000 7f8404a00640 1 -- 172.21.15.42:0/478327052 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40327e0 con 0x7f84000ad960 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 -- 172.21.15.42:0/478327052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ad960 msgr2=0x7f840015b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ad960 0x7f840015b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009850 tx=0x7f83f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 -- 172.21.15.42:0/478327052 shutdown_connections 2024-08-17T02:30:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f8400156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 --2- 172.21.15.42:0/478327052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ad960 0x7f840015b0a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 -- 172.21.15.42:0/478327052 >> 172.21.15.42:0/478327052 conn(0x7f8400066e60 msgr2=0x7f8400067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 -- 172.21.15.42:0/478327052 shutdown_connections 2024-08-17T02:30:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.303+0000 7f8408800640 1 -- 172.21.15.42:0/478327052 wait complete. 2024-08-17T02:30:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.304+0000 7f8408800640 1 Processor -- start 2024-08-17T02:30:42.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.305+0000 7f8408800640 1 -- start start 2024-08-17T02:30:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.305+0000 7f8408800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84000ad960 0x7f8400151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.305+0000 7f8408800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f840015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.305+0000 7f8408800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 0x7f84000ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8408800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000ad490 con 0x7f84000ca050 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8408800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8400169560 con 0x7f84000ad960 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8408800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840015cca0 con 0x7f84000add30 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 0x7f84000ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 0x7f84000ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47928/0 (socket says 172.21.15.42:47928) 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 -- 172.21.15.42:0/1883222025 learned_addr learned my addr 172.21.15.42:0/1883222025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8405e00640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84000ad960 0x7f8400151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8405400640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f840015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 -- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 msgr2=0x7f840015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f840015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 -- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84000ad960 msgr2=0x7f8400151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84000ad960 0x7f8400151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.306+0000 7f8406800640 1 -- 172.21.15.42:0/1883222025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009390 con 0x7f84000ca050 2024-08-17T02:30:42.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.307+0000 7f8406800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 0x7f84000ac2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00a380 tx=0x7f83fc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.307+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00d650 con 0x7f84000ca050 2024-08-17T02:30:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.307+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc00d7b0 con 0x7f84000ca050 2024-08-17T02:30:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.307+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00db70 con 0x7f84000ca050 2024-08-17T02:30:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.307+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84000aced0 con 0x7f84000ca050 2024-08-17T02:30:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.307+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840015c930 con 0x7f84000ca050 2024-08-17T02:30:42.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.308+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8400063fb0 con 0x7f84000ca050 2024-08-17T02:30:42.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.309+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f83fc01e3b0 con 0x7f84000ca050 2024-08-17T02:30:42.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.310+0000 7f83f9600640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f83e4065220 0x7f83e40676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.310+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f83fc082e90 con 0x7f84000ca050 2024-08-17T02:30:42.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.310+0000 7f8405e00640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f83e4065220 0x7f83e40676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.311+0000 7f8405e00640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f83e4065220 0x7f83e40676d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f83f4034000 tx=0x7f83f4032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.314+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f83fc051000 con 0x7f84000ca050 2024-08-17T02:30:42.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.538+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000001039443"} v 0) v1 -- 0x7f84000a8dd0 con 0x7f84000ca050 2024-08-17T02:30:42.540 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-08-17T02:30:42.539+0000 7f3018a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:30:42.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.543+0000 7f83f9600640 1 -- 172.21.15.42:0/1883222025 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000001039443"}]=0 volume_0000000001039443 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 195+0+0 (secure 0 0 0) 0x7f83fc01a0a0 con 0x7f84000ca050 2024-08-17T02:30:42.544 INFO:teuthology.orchestra.run.smithi042.stderr:volume_0000000001039443 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f83e4065220 msgr2=0x7f83e40676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f83e4065220 0x7f83e40676d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f83f4034000 tx=0x7f83f4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 msgr2=0x7f84000ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 0x7f84000ac2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00a380 tx=0x7f83fc007900 comp rx=0 tx=0).stop 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 shutdown_connections 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f83e4065220 0x7f83e40676d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84000ca050 0x7f84000ac2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f84000add30 0x7f840015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 --2- 172.21.15.42:0/1883222025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84000ad960 0x7f8400151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.545+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 >> 172.21.15.42:0/1883222025 conn(0x7f8400066e60 msgr2=0x7f8400155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:42.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.546+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 shutdown_connections 2024-08-17T02:30:42.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.546+0000 7f8408800640 1 -- 172.21.15.42:0/1883222025 wait complete. 2024-08-17T02:30:42.554 INFO:tasks.ceph.mds.d.smithi062.stderr: -3082> 2024-08-17T02:28:34.865+0000 7f8530e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:42.562 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000001039443 --yes-i-really-mean-it 2024-08-17T02:30:42.597 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-08-17T02:30:42.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.713+0000 7f8c97e00640 1 Processor -- start 2024-08-17T02:30:42.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.714+0000 7f8c97e00640 1 -- start start 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c97e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c980b1850 0x7f8c980b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c97e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8c981585a0 0x7f8c981589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c97e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c980ce770 con 0x7f8c980d0650 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c97e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980ce9b0 con 0x7f8c980b1850 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c97e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c980cec90 con 0x7f8c981585a0 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c96a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c980b1850 0x7f8c980b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c96a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c980b1850 0x7f8c980b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47938/0 (socket says 172.21.15.42:47938) 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c96a00640 1 -- 172.21.15.42:0/4150374751 learned_addr learned my addr 172.21.15.42:0/4150374751 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c97400640 1 --2- 172.21.15.42:0/4150374751 >> v2:172.21.15.62:3300/0 conn(0x7f8c981585a0 0x7f8c981589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c96a00640 1 -- 172.21.15.42:0/4150374751 >> v2:172.21.15.62:3300/0 conn(0x7f8c981585a0 msgr2=0x7f8c981589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:42.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c96a00640 1 --2- 172.21.15.42:0/4150374751 >> v2:172.21.15.62:3300/0 conn(0x7f8c981585a0 0x7f8c981589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.715+0000 7f8c96a00640 1 -- 172.21.15.42:0/4150374751 >> v1:172.21.15.62:6789/0 conn(0x7f8c980d0650 legacy=0x7f8c980ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:42.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.716+0000 7f8c96a00640 1 -- 172.21.15.42:0/4150374751 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980cef70 con 0x7f8c980b1850 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c96a00640 1 --2- 172.21.15.42:0/4150374751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c980b1c20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8c98088a20 tx=0x7f8c880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb703fab3f15922 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c96000640 1 -- 172.21.15.42:0/4150374751 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8802add0 con 0x7f8c980b1850 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c96000640 1 -- 172.21.15.42:0/4150374751 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88032440 con 0x7f8c980b1850 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c96000640 1 -- 172.21.15.42:0/4150374751 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88032820 con 0x7f8c980b1850 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c97e00640 1 -- 172.21.15.42:0/4150374751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 msgr2=0x7f8c980b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c97e00640 1 --2- 172.21.15.42:0/4150374751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c980b1c20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8c98088a20 tx=0x7f8c880091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c97e00640 1 -- 172.21.15.42:0/4150374751 shutdown_connections 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c97e00640 1 --2- 172.21.15.42:0/4150374751 >> v2:172.21.15.62:3300/0 conn(0x7f8c981585a0 0x7f8c981589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c97e00640 1 --2- 172.21.15.42:0/4150374751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c980b1c20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.717+0000 7f8c97e00640 1 -- 172.21.15.42:0/4150374751 >> 172.21.15.42:0/4150374751 conn(0x7f8c9806e590 msgr2=0x7f8c9806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:42.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.718+0000 7f8c97e00640 1 -- 172.21.15.42:0/4150374751 shutdown_connections 2024-08-17T02:30:42.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.718+0000 7f8c97e00640 1 -- 172.21.15.42:0/4150374751 wait complete. 2024-08-17T02:30:42.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.719+0000 7f8c97e00640 1 Processor -- start 2024-08-17T02:30:42.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.719+0000 7f8c97e00640 1 -- start start 2024-08-17T02:30:42.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c981436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c980d0650 0x7f8c9815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c981585a0 0x7f8c9815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9815a6f0 con 0x7f8c980b1850 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98143c30 con 0x7f8c981585a0 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98154440 con 0x7f8c980d0650 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c96a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c981436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c96a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c981436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47940/0 (socket says 172.21.15.42:47940) 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c96a00640 1 -- 172.21.15.42:0/1487497150 learned_addr learned my addr 172.21.15.42:0/1487497150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c8fe00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c980d0650 0x7f8c9815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.720+0000 7f8c97400640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c981585a0 0x7f8c9815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c96a00640 1 -- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c980d0650 msgr2=0x7f8c9815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c96a00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c980d0650 0x7f8c9815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c96a00640 1 -- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c981585a0 msgr2=0x7f8c9815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c96a00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c981585a0 0x7f8c9815cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c96a00640 1 -- 172.21.15.42:0/1487497150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88009450 con 0x7f8c980b1850 2024-08-17T02:30:42.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c96a00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c981436f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c88035040 tx=0x7f8c88032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88000d10 con 0x7f8c980b1850 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88031de0 con 0x7f8c980b1850 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8803d670 con 0x7f8c980b1850 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9815a0a0 con 0x7f8c980b1850 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.721+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c981536a0 con 0x7f8c980b1850 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.722+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c98159f00 con 0x7f8c980b1850 2024-08-17T02:30:42.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.723+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8c88039040 con 0x7f8c980b1850 2024-08-17T02:30:42.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.724+0000 7f8c8e000640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c74065150 0x7f8c74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:42.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.724+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f8c880a22e0 con 0x7f8c980b1850 2024-08-17T02:30:42.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.724+0000 7f8c8fe00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c74065150 0x7f8c74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:42.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.725+0000 7f8c8fe00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c74065150 0x7f8c74067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8c9815c420 tx=0x7f8c80007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:42.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.728+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8c98159f00 con 0x7f8c980b1850 2024-08-17T02:30:42.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:42.954+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000001039443", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8c980ce770 con 0x7f8c980b1850 2024-08-17T02:30:43.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.545+0000 7f8c8e000640 1 -- 172.21.15.42:0/1487497150 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000001039443", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 121+0+0 (secure 0 0 0) 0x7f8c980ce770 con 0x7f8c980b1850 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c74065150 msgr2=0x7f8c74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c74065150 0x7f8c74067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8c9815c420 tx=0x7f8c80007e10 comp rx=0 tx=0).stop 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 msgr2=0x7f8c981436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c981436f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8c88035040 tx=0x7f8c88032000 comp rx=0 tx=0).stop 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 shutdown_connections 2024-08-17T02:30:43.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8c74065150 0x7f8c74067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8c981585a0 0x7f8c9815cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8c980d0650 0x7f8c9815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1487497150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c980b1850 0x7f8c981436f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.547+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 >> 172.21.15.42:0/1487497150 conn(0x7f8c9806e590 msgr2=0x7f8c980afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.548+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 shutdown_connections 2024-08-17T02:30:43.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.548+0000 7f8c97e00640 1 -- 172.21.15.42:0/1487497150 wait complete. 2024-08-17T02:30:43.567 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001039443.meta cephfs.volume_0000000001039443.meta --yes-i-really-really-mean-it 2024-08-17T02:30:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.727+0000 7f875b400640 1 Processor -- start 2024-08-17T02:30:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.727+0000 7f875b400640 1 -- start start 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.728+0000 7f875b400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87540ac000 0x7f8754156a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.728+0000 7f875b400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8754159ad0 con 0x7f87540ad020 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.728+0000 7f875b400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8754156f40 con 0x7f87540afa00 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.728+0000 7f875b400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87540ad590 con 0x7f87540ac000 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.728+0000 7f8758a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87540ac000 0x7f8754156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.729+0000 7f8753e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f87540ad020 0x7f8754159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43728/0 (socket says 172.21.15.42:43728) 2024-08-17T02:30:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.729+0000 7f8753e00640 1 -- 172.21.15.42:0/3203279453 learned_addr learned my addr 172.21.15.42:0/3203279453 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.729+0000 7f8758a00640 1 -- 172.21.15.42:0/3203279453 >> v1:172.21.15.62:6789/0 conn(0x7f87540afa00 legacy=0x7f87540afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.729+0000 7f8758a00640 1 -- 172.21.15.42:0/3203279453 >> v1:172.21.15.42:6789/0 conn(0x7f87540ad020 legacy=0x7f8754159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.729+0000 7f8758a00640 1 -- 172.21.15.42:0/3203279453 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87540ad870 con 0x7f87540ac000 2024-08-17T02:30:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.730+0000 7f8758a00640 1 --2- 172.21.15.42:0/3203279453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ac000 0x7f8754156a00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8748009850 tx=0x7f87480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0f6863bce1b74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.730+0000 7f8753400640 1 -- 172.21.15.42:0/3203279453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874802ad00 con 0x7f87540ac000 2024-08-17T02:30:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.730+0000 7f8753400640 1 -- 172.21.15.42:0/3203279453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874802ae60 con 0x7f87540ac000 2024-08-17T02:30:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.730+0000 7f8753400640 1 -- 172.21.15.42:0/3203279453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748032670 con 0x7f87540ac000 2024-08-17T02:30:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 -- 172.21.15.42:0/3203279453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ac000 msgr2=0x7f8754156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 --2- 172.21.15.42:0/3203279453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ac000 0x7f8754156a00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8748009850 tx=0x7f87480090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 -- 172.21.15.42:0/3203279453 shutdown_connections 2024-08-17T02:30:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 --2- 172.21.15.42:0/3203279453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ac000 0x7f8754156a00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 -- 172.21.15.42:0/3203279453 >> 172.21.15.42:0/3203279453 conn(0x7f8754066e60 msgr2=0x7f8754067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 -- 172.21.15.42:0/3203279453 shutdown_connections 2024-08-17T02:30:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.731+0000 7f875b400640 1 -- 172.21.15.42:0/3203279453 wait complete. 2024-08-17T02:30:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.732+0000 7f875b400640 1 Processor -- start 2024-08-17T02:30:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 -- start start 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87540ac000 0x7f8754141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 0x7f875412ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87540afa00 0x7f8754142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754149f00 con 0x7f87540ad020 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875414af10 con 0x7f87540afa00 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.733+0000 7f875b400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875414c920 con 0x7f87540ac000 2024-08-17T02:30:43.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 0x7f875412ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 0x7f875412ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47956/0 (socket says 172.21.15.42:47956) 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 -- 172.21.15.42:0/2405079075 learned_addr learned my addr 172.21.15.42:0/2405079075 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 -- 172.21.15.42:0/2405079075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87540ac000 msgr2=0x7f8754141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87540ac000 0x7f8754141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 -- 172.21.15.42:0/2405079075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87540afa00 msgr2=0x7f8754142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87540afa00 0x7f8754142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 -- 172.21.15.42:0/2405079075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009390 con 0x7f87540ad020 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8753e00640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 0x7f875412ee60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f874000c590 tx=0x7f8740007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.734+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740005aa0 con 0x7f87540ad020 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.735+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740005c20 con 0x7f87540ad020 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.735+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400070f0 con 0x7f87540ad020 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.735+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875414cc00 con 0x7f87540ad020 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.735+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875414b4a0 con 0x7f87540ad020 2024-08-17T02:30:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.736+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8754063fb0 con 0x7f87540ad020 2024-08-17T02:30:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.736+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8740007500 con 0x7f87540ad020 2024-08-17T02:30:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.737+0000 7f8747e00640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8734065150 0x7f8734067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.737+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f8740081540 con 0x7f87540ad020 2024-08-17T02:30:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.738+0000 7f8758a00640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8734065150 0x7f8734067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.738+0000 7f8758a00640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8734065150 0x7f8734067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8748034000 tx=0x7f8748032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.741+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f874004f500 con 0x7f87540ad020 2024-08-17T02:30:43.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:43.928+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039443.meta", "pool2": "cephfs.volume_0000000001039443.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8754067c10 con 0x7f87540ad020 2024-08-17T02:30:44.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.724+0000 7f8747e00640 1 -- 172.21.15.42:0/2405079075 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039443.meta", "pool2": "cephfs.volume_0000000001039443.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001039443.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f8740052b20 con 0x7f87540ad020 2024-08-17T02:30:44.726 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs.volume_0000000001039443.meta' removed 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8734065150 msgr2=0x7f8734067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8734065150 0x7f8734067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8748034000 tx=0x7f8748032000 comp rx=0 tx=0).stop 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 msgr2=0x7f875412ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 0x7f875412ee60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f874000c590 tx=0x7f8740007ee0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 shutdown_connections 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f8734065150 0x7f8734067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87540afa00 0x7f8754142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87540ad020 0x7f875412ee60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 --2- 172.21.15.42:0/2405079075 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f87540ac000 0x7f8754141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.728+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 >> 172.21.15.42:0/2405079075 conn(0x7f8754066e60 msgr2=0x7f875406e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.729+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 shutdown_connections 2024-08-17T02:30:44.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.729+0000 7f875b400640 1 -- 172.21.15.42:0/2405079075 wait complete. 2024-08-17T02:30:44.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000001039443.data cephfs.volume_0000000001039443.data --yes-i-really-really-mean-it 2024-08-17T02:30:44.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.906+0000 7f1f49e00640 1 Processor -- start 2024-08-17T02:30:44.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.907+0000 7f1f49e00640 1 -- start start 2024-08-17T02:30:44.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f49e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1f441589f0 0x7f1f440ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f49e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440b3ac0 con 0x7f1f440cf520 2024-08-17T02:30:44.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f49e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440b3190 con 0x7f1f44158dc0 2024-08-17T02:30:44.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f49e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440b3470 con 0x7f1f441589f0 2024-08-17T02:30:44.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f48a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1f441589f0 0x7f1f440ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f49400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1f440cf520 0x7f1f440cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43736/0 (socket says 172.21.15.42:43736) 2024-08-17T02:30:44.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.908+0000 7f1f49400640 1 -- 172.21.15.42:0/3074444476 learned_addr learned my addr 172.21.15.42:0/3074444476 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.909+0000 7f1f48a00640 1 -- 172.21.15.42:0/3074444476 >> v1:172.21.15.62:6789/0 conn(0x7f1f44158dc0 legacy=0x7f1f440ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.909+0000 7f1f48a00640 1 -- 172.21.15.42:0/3074444476 >> v1:172.21.15.42:6789/0 conn(0x7f1f440cf520 legacy=0x7f1f440cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.909+0000 7f1f48a00640 1 -- 172.21.15.42:0/3074444476 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440b3750 con 0x7f1f441589f0 2024-08-17T02:30:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.909+0000 7f1f43400640 1 -- 172.21.15.42:0/3074444476 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875142059 0 0) 0x7f1f440b3ac0 con 0x7f1f440cf520 2024-08-17T02:30:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.910+0000 7f1f48a00640 1 --2- 172.21.15.42:0/3074444476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f441589f0 0x7f1f440ce7e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009850 tx=0x7f1f380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2e7943437e0c8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.910+0000 7f1f43400640 1 -- 172.21.15.42:0/3074444476 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3802ae20 con 0x7f1f441589f0 2024-08-17T02:30:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.910+0000 7f1f43400640 1 -- 172.21.15.42:0/3074444476 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38032440 con 0x7f1f441589f0 2024-08-17T02:30:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.910+0000 7f1f43400640 1 -- 172.21.15.42:0/3074444476 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380327e0 con 0x7f1f441589f0 2024-08-17T02:30:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 -- 172.21.15.42:0/3074444476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f441589f0 msgr2=0x7f1f440ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3074444476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f441589f0 0x7f1f440ce7e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009850 tx=0x7f1f380090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 -- 172.21.15.42:0/3074444476 shutdown_connections 2024-08-17T02:30:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3074444476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f441589f0 0x7f1f440ce7e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 -- 172.21.15.42:0/3074444476 >> 172.21.15.42:0/3074444476 conn(0x7f1f44087a80 msgr2=0x7f1f4406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 -- 172.21.15.42:0/3074444476 shutdown_connections 2024-08-17T02:30:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.911+0000 7f1f49e00640 1 -- 172.21.15.42:0/3074444476 wait complete. 2024-08-17T02:30:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.912+0000 7f1f49e00640 1 Processor -- start 2024-08-17T02:30:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.912+0000 7f1f49e00640 1 -- start start 2024-08-17T02:30:44.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 0x7f1f44159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f441589f0 0x7f1f4414f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f49e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f44158dc0 0x7f1f4414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f49e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440b08d0 con 0x7f1f440cf520 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f49e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4414ee10 con 0x7f1f44158dc0 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f49e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440b22f0 con 0x7f1f441589f0 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f48a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 0x7f1f44159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f48a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 0x7f1f44159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47968/0 (socket says 172.21.15.42:47968) 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.913+0000 7f1f48a00640 1 -- 172.21.15.42:0/3895272320 learned_addr learned my addr 172.21.15.42:0/3895272320 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f49400640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f44158dc0 0x7f1f4414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f43e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f441589f0 0x7f1f4414f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f48a00640 1 -- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f441589f0 msgr2=0x7f1f4414f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f48a00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f441589f0 0x7f1f4414f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f48a00640 1 -- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f44158dc0 msgr2=0x7f1f4414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f48a00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f44158dc0 0x7f1f4414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f48a00640 1 -- 172.21.15.42:0/3895272320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38009390 con 0x7f1f440cf520 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f49400640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f44158dc0 0x7f1f4414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f48a00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 0x7f1f44159190 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009850 tx=0x7f1f38032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38031b30 con 0x7f1f440cf520 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38031cd0 con 0x7f1f440cf520 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3803d670 con 0x7f1f440cf520 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4414e4e0 con 0x7f1f440cf520 2024-08-17T02:30:44.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.914+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4414eaa0 con 0x7f1f440cf520 2024-08-17T02:30:44.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.915+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f44063f10 con 0x7f1f440cf520 2024-08-17T02:30:44.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.916+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1f38039040 con 0x7f1f440cf520 2024-08-17T02:30:44.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.917+0000 7f1f37e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1f24065150 0x7f1f24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.917+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f1f380a2180 con 0x7f1f440cf520 2024-08-17T02:30:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.917+0000 7f1f43e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1f24065150 0x7f1f24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.918+0000 7f1f43e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1f24065150 0x7f1f24067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f440cbb60 tx=0x7f1f30009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:44.921+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1f38070360 con 0x7f1f440cf520 2024-08-17T02:30:45.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.112+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039443.data", "pool2": "cephfs.volume_0000000001039443.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f440b5430 con 0x7f1f440cf520 2024-08-17T02:30:45.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.733+0000 7f1f37e00640 1 -- 172.21.15.42:0/3895272320 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000001039443.data", "pool2": "cephfs.volume_0000000001039443.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000001039443.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f1f38073980 con 0x7f1f440cf520 2024-08-17T02:30:45.735 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs.volume_0000000001039443.data' removed 2024-08-17T02:30:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1f24065150 msgr2=0x7f1f24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1f24065150 0x7f1f24067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1f440cbb60 tx=0x7f1f30009040 comp rx=0 tx=0).stop 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 msgr2=0x7f1f44159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 0x7f1f44159190 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009850 tx=0x7f1f38032000 comp rx=0 tx=0).stop 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 shutdown_connections 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1f24065150 0x7f1f24067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f44158dc0 0x7f1f4414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f441589f0 0x7f1f4414f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 --2- 172.21.15.42:0/3895272320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f440cf520 0x7f1f44159190 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 >> 172.21.15.42:0/3895272320 conn(0x7f1f44087a80 msgr2=0x7f1f44154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 shutdown_connections 2024-08-17T02:30:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.737+0000 7f1f49e00640 1 -- 172.21.15.42:0/3895272320 wait complete. 2024-08-17T02:30:45.756 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:30:45.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.913+0000 7f0e3d600640 1 Processor -- start 2024-08-17T02:30:45.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.913+0000 7f0e3d600640 1 -- start start 2024-08-17T02:30:45.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e3d600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e380ca050 0x7f0e38156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e3d600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e380add30 0x7f0e3815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e3d600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3815b5e0 con 0x7f0e380ad960 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e3d600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380cb160 con 0x7f0e380ca050 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e3d600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380b0d10 con 0x7f0e380add30 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e36000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0e380ca050 0x7f0e38156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e36a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0e380ad960 0x7f0e38156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43744/0 (socket says 172.21.15.42:43744) 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e36a00640 1 -- 172.21.15.42:0/2635911072 learned_addr learned my addr 172.21.15.42:0/2635911072 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:45.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.914+0000 7f0e37400640 1 --2- 172.21.15.42:0/2635911072 >> v2:172.21.15.62:3300/0 conn(0x7f0e380add30 0x7f0e3815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.915+0000 7f0e36000640 1 -- 172.21.15.42:0/2635911072 >> v2:172.21.15.62:3300/0 conn(0x7f0e380add30 msgr2=0x7f0e3815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.915+0000 7f0e36000640 1 --2- 172.21.15.42:0/2635911072 >> v2:172.21.15.62:3300/0 conn(0x7f0e380add30 0x7f0e3815b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.915+0000 7f0e36000640 1 -- 172.21.15.42:0/2635911072 >> v1:172.21.15.42:6789/0 conn(0x7f0e380ad960 legacy=0x7f0e38156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.915+0000 7f0e36000640 1 -- 172.21.15.42:0/2635911072 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380ca550 con 0x7f0e380ca050 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.915+0000 7f0e35600640 1 -- 172.21.15.42:0/2635911072 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236636936 0 0) 0x7f0e28001110 con 0x7f0e380ad960 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.916+0000 7f0e36000640 1 --2- 172.21.15.42:0/2635911072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380ca050 0x7f0e38156b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cb0d0 tx=0x7f0e240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa69014efe3d5d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.916+0000 7f0e35600640 1 -- 172.21.15.42:0/2635911072 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2402ae40 con 0x7f0e380ca050 2024-08-17T02:30:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.916+0000 7f0e35600640 1 -- 172.21.15.42:0/2635911072 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24032440 con 0x7f0e380ca050 2024-08-17T02:30:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.916+0000 7f0e35600640 1 -- 172.21.15.42:0/2635911072 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e240327e0 con 0x7f0e380ca050 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 -- 172.21.15.42:0/2635911072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380ca050 msgr2=0x7f0e38156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 --2- 172.21.15.42:0/2635911072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380ca050 0x7f0e38156b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cb0d0 tx=0x7f0e240090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 -- 172.21.15.42:0/2635911072 shutdown_connections 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 --2- 172.21.15.42:0/2635911072 >> v2:172.21.15.62:3300/0 conn(0x7f0e380add30 0x7f0e3815b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 --2- 172.21.15.42:0/2635911072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380ca050 0x7f0e38156b30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 -- 172.21.15.42:0/2635911072 >> 172.21.15.42:0/2635911072 conn(0x7f0e38066e60 msgr2=0x7f0e38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 -- 172.21.15.42:0/2635911072 shutdown_connections 2024-08-17T02:30:45.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.917+0000 7f0e3d600640 1 -- 172.21.15.42:0/2635911072 wait complete. 2024-08-17T02:30:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.918+0000 7f0e3d600640 1 Processor -- start 2024-08-17T02:30:45.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.918+0000 7f0e3d600640 1 -- start start 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e3d600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e380ad960 0x7f0e38145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e3d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 0x7f0e38166f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e3d600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e380ca050 0x7f0e38153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e3d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e38167e70 con 0x7f0e380add30 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e3d600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3816a9e0 con 0x7f0e380ca050 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e3d600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e38145a80 con 0x7f0e380ad960 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e36000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 0x7f0e38166f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e36000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 0x7f0e38166f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47986/0 (socket says 172.21.15.42:47986) 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.919+0000 7f0e36000640 1 -- 172.21.15.42:0/697512969 learned_addr learned my addr 172.21.15.42:0/697512969 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36a00640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e380ad960 0x7f0e38145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e37400640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e380ca050 0x7f0e38153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36000640 1 -- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e380ad960 msgr2=0x7f0e38145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36000640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e380ad960 0x7f0e38145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36000640 1 -- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e380ca050 msgr2=0x7f0e38153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36000640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e380ca050 0x7f0e38153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36000640 1 -- 172.21.15.42:0/697512969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24009390 con 0x7f0e380add30 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e37400640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e380ca050 0x7f0e38153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36a00640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e380ad960 0x7f0e38145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e36000640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 0x7f0e38166f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0e24035040 tx=0x7f0e24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24031de0 con 0x7f0e380add30 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2403e450 con 0x7f0e380add30 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2403e850 con 0x7f0e380add30 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.920+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e381678b0 con 0x7f0e380add30 2024-08-17T02:30:45.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.921+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3816a670 con 0x7f0e380add30 2024-08-17T02:30:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.922+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3816ab50 con 0x7f0e380add30 2024-08-17T02:30:45.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.922+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e2403c400 con 0x7f0e380add30 2024-08-17T02:30:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.923+0000 7f0e2e000640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e18065180 0x7f0e18067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.924+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0e2402ae40 con 0x7f0e380add30 2024-08-17T02:30:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.924+0000 7f0e36a00640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e18065180 0x7f0e18067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.924+0000 7f0e36a00640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e18065180 0x7f0e18067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e28007fd0 tx=0x7f0e28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:45.927+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e24070d90 con 0x7f0e380add30 2024-08-17T02:30:46.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.119+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0e38063fb0 con 0x7f0e380add30 2024-08-17T02:30:46.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.123+0000 7f0e2e000640 1 -- 172.21.15.42:0/697512969 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e240743b0 con 0x7f0e380add30 2024-08-17T02:30:46.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e18065180 msgr2=0x7f0e18067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e18065180 0x7f0e18067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e28007fd0 tx=0x7f0e28009040 comp rx=0 tx=0).stop 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 msgr2=0x7f0e38166f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 0x7f0e38166f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0e24035040 tx=0x7f0e24032000 comp rx=0 tx=0).stop 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 shutdown_connections 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0e18065180 0x7f0e18067630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e380ca050 0x7f0e38153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e380add30 0x7f0e38166f40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 --2- 172.21.15.42:0/697512969 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e380ad960 0x7f0e38145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 >> 172.21.15.42:0/697512969 conn(0x7f0e38066e60 msgr2=0x7f0e381549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 shutdown_connections 2024-08-17T02:30:46.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.126+0000 7f0e3d600640 1 -- 172.21.15.42:0/697512969 wait complete. 2024-08-17T02:30:46.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:30:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.294+0000 7f0751400640 1 Processor -- start 2024-08-17T02:30:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.294+0000 7f0751400640 1 -- start start 2024-08-17T02:30:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.295+0000 7f0751400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156870 0x7f074c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.295+0000 7f0751400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f074c0b12f0 0x7f074c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.295+0000 7f0751400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074c157ab0 con 0x7f074c156c40 2024-08-17T02:30:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.295+0000 7f0751400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074c0ae440 con 0x7f074c0b12f0 2024-08-17T02:30:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.295+0000 7f0751400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0cb5d0 con 0x7f074c156870 2024-08-17T02:30:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.295+0000 7f074b200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f074c0b12f0 0x7f074c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074b200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f074c0b12f0 0x7f074c0caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47988/0 (socket says 172.21.15.42:47988) 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074b200640 1 -- 172.21.15.42:0/3947612742 learned_addr learned my addr 172.21.15.42:0/3947612742 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074a800640 1 --2- 172.21.15.42:0/3947612742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156870 0x7f074c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074b200640 1 -- 172.21.15.42:0/3947612742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156870 msgr2=0x7f074c0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074b200640 1 --2- 172.21.15.42:0/3947612742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156870 0x7f074c0caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074b200640 1 -- 172.21.15.42:0/3947612742 >> v1:172.21.15.62:6789/0 conn(0x7f074c156c40 legacy=0x7f074c0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.296+0000 7f074b200640 1 -- 172.21.15.42:0/3947612742 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c157180 con 0x7f074c0b12f0 2024-08-17T02:30:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.297+0000 7f074b200640 1 --2- 172.21.15.42:0/3947612742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c0caf50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0744009f20 tx=0x7f0744009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654645bbbc00cad3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.297+0000 7f0749400640 1 -- 172.21.15.42:0/3947612742 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0744031400 con 0x7f074c0b12f0 2024-08-17T02:30:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.297+0000 7f0749400640 1 -- 172.21.15.42:0/3947612742 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074402d050 con 0x7f074c0b12f0 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.297+0000 7f0749400640 1 -- 172.21.15.42:0/3947612742 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07440317d0 con 0x7f074c0b12f0 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 -- 172.21.15.42:0/3947612742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 msgr2=0x7f074c0caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 --2- 172.21.15.42:0/3947612742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c0caf50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0744009f20 tx=0x7f0744009840 comp rx=0 tx=0).stop 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 -- 172.21.15.42:0/3947612742 shutdown_connections 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 --2- 172.21.15.42:0/3947612742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c0caf50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 --2- 172.21.15.42:0/3947612742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156870 0x7f074c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 -- 172.21.15.42:0/3947612742 >> 172.21.15.42:0/3947612742 conn(0x7f074c066e60 msgr2=0x7f074c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 -- 172.21.15.42:0/3947612742 shutdown_connections 2024-08-17T02:30:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.298+0000 7f0751400640 1 -- 172.21.15.42:0/3947612742 wait complete. 2024-08-17T02:30:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.299+0000 7f0751400640 1 Processor -- start 2024-08-17T02:30:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.299+0000 7f0751400640 1 -- start start 2024-08-17T02:30:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.300+0000 7f0751400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c13d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.300+0000 7f0751400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f074c156870 0x7f074c158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.300+0000 7f0751400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156c40 0x7f074c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.300+0000 7f0751400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c1514e0 con 0x7f074c0b12f0 2024-08-17T02:30:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.300+0000 7f0751400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c7a90 con 0x7f074c156870 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.300+0000 7f0751400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c0c6e80 con 0x7f074c156c40 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c13d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c13d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47994/0 (socket says 172.21.15.42:47994) 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 -- 172.21.15.42:0/1043781739 learned_addr learned my addr 172.21.15.42:0/1043781739 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074b200640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156c40 0x7f074c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f0749e00640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f074c156870 0x7f074c158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 -- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156c40 msgr2=0x7f074c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156c40 0x7f074c15ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 -- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f074c156870 msgr2=0x7f074c158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f074c156870 0x7f074c158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 -- 172.21.15.42:0/1043781739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009ae0 con 0x7f074c0b12f0 2024-08-17T02:30:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f074a800640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c13d230 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f073c00d890 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.301+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00de20 con 0x7f074c0b12f0 2024-08-17T02:30:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.302+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c0098b0 con 0x7f074c0b12f0 2024-08-17T02:30:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.302+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c009c50 con 0x7f074c0b12f0 2024-08-17T02:30:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.302+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074c0c7160 con 0x7f074c0b12f0 2024-08-17T02:30:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.302+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c0c7720 con 0x7f074c0b12f0 2024-08-17T02:30:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.303+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c063fb0 con 0x7f074c0b12f0 2024-08-17T02:30:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.304+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f073c014620 con 0x7f074c0b12f0 2024-08-17T02:30:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.304+0000 7f0742000640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f072c065180 0x7f072c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.305+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f073c082a20 con 0x7f074c0b12f0 2024-08-17T02:30:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.305+0000 7f0749e00640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f072c065180 0x7f072c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.305+0000 7f0749e00640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f072c065180 0x7f072c067630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f074c068540 tx=0x7f0738009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.309+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f073c050ce0 con 0x7f074c0b12f0 2024-08-17T02:30:46.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.557+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f074c0ad560 con 0x7f074c0b12f0 2024-08-17T02:30:46.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.734+0000 7f0742000640 1 -- 172.21.15.42:0/1043781739 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v155) v1 ==== 135+0+0 (secure 0 0 0) 0x7f073c009db0 con 0x7f074c0b12f0 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f072c065180 msgr2=0x7f072c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f072c065180 0x7f072c067630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f074c068540 tx=0x7f0738009040 comp rx=0 tx=0).stop 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 msgr2=0x7f074c13d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c13d230 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f073c00d890 tx=0x7f073c008040 comp rx=0 tx=0).stop 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 shutdown_connections 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f072c065180 0x7f072c067630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f074c156c40 0x7f074c15ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f074c156870 0x7f074c158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 --2- 172.21.15.42:0/1043781739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f074c0b12f0 0x7f074c13d230 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 >> 172.21.15.42:0/1043781739 conn(0x7f074c066e60 msgr2=0x7f074c1544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 shutdown_connections 2024-08-17T02:30:46.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:46.736+0000 7f0751400640 1 -- 172.21.15.42:0/1043781739 wait complete. 2024-08-17T02:30:46.756 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:30:46.757 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:30:46.758 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi042 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039443 --yes-i-really-mean-it' 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.979s 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:30:46.759 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:30:46.760 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:30:46.761 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:30:46.761 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:30:46.761 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:30:46.761 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi042 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000001039443 --yes-i-really-mean-it' 2024-08-17T02:30:46.761 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:46.761 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:47.011 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=50ddd309d63e4dddad00a92accf9248b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:47.012 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:30:47.020 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:30:47.028 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:30:47.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.028 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:30:47.068 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:30:47.068 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:30:47.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.069 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:30:47.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:30:47.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.428 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-17T02:30:47.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.716 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-08-17T02:30:47.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.753 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-08-17T02:30:47.852 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-08-17T02:30:47.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.855 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:30:47.895 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:30:47.896 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:30:47.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:30:47.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:47.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:30:48.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:48.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-08-17T02:30:48.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:48.623 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-08-17T02:30:48.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:48.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-08-17T02:30:48.760 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-08-17T02:30:48.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:30:48.763 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:30:48.772 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:30:48.772 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:48.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.933+0000 7f7a52400640 1 Processor -- start 2024-08-17T02:30:48.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.933+0000 7f7a52400640 1 -- start start 2024-08-17T02:30:48.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.934+0000 7f7a52400640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.934+0000 7f7a52400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c15b5e0 con 0x7f7a4c0ca050 2024-08-17T02:30:48.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.934+0000 7f7a52400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4c0cb160 con 0x7f7a4c0add30 2024-08-17T02:30:48.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.934+0000 7f7a52400640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4c0b0d10 con 0x7f7a4c0ad960 2024-08-17T02:30:48.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.934+0000 7f7a4aa00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7a4c0ca050 0x7f7a4c156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43756/0 (socket says 172.21.15.42:43756) 2024-08-17T02:30:48.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.934+0000 7f7a4aa00640 1 -- 172.21.15.42:0/4139710339 learned_addr learned my addr 172.21.15.42:0/4139710339 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:48.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4b400640 1 --2- 172.21.15.42:0/4139710339 >> v2:172.21.15.62:3300/0 conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717070422 0 0) 0x7f7a38001110 con 0x7f7a4c0ca050 2024-08-17T02:30:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a300034e0 con 0x7f7a4c0ca050 2024-08-17T02:30:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373193056 0 0) 0x7f7a4c0cb160 con 0x7f7a4c0add30 2024-08-17T02:30:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a38001110 con 0x7f7a4c0add30 2024-08-17T02:30:48.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4b400640 1 -- 172.21.15.42:0/4139710339 >> v1:172.21.15.62:6789/0 conn(0x7f7a4c0add30 legacy=0x7f7a4c0aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4b400640 1 -- 172.21.15.42:0/4139710339 >> v1:172.21.15.42:6789/0 conn(0x7f7a4c0ca050 legacy=0x7f7a4c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.935+0000 7f7a4b400640 1 -- 172.21.15.42:0/4139710339 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0ca550 con 0x7f7a4c0ad960 2024-08-17T02:30:48.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.936+0000 7f7a4b400640 1 --2- 172.21.15.42:0/4139710339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009850 tx=0x7f7a3c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b132586dfbdadeb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.936+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c032440 con 0x7f7a4c0ad960 2024-08-17T02:30:48.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.936+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0325a0 con 0x7f7a4c0ad960 2024-08-17T02:30:48.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.936+0000 7f7a4a000640 1 -- 172.21.15.42:0/4139710339 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c032940 con 0x7f7a4c0ad960 2024-08-17T02:30:48.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 -- 172.21.15.42:0/4139710339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 msgr2=0x7f7a4c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 --2- 172.21.15.42:0/4139710339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009850 tx=0x7f7a3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 -- 172.21.15.42:0/4139710339 shutdown_connections 2024-08-17T02:30:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 --2- 172.21.15.42:0/4139710339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c15b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 -- 172.21.15.42:0/4139710339 >> 172.21.15.42:0/4139710339 conn(0x7f7a4c066e60 msgr2=0x7f7a4c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 -- 172.21.15.42:0/4139710339 shutdown_connections 2024-08-17T02:30:48.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.937+0000 7f7a52400640 1 -- 172.21.15.42:0/4139710339 wait complete. 2024-08-17T02:30:48.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.938+0000 7f7a52400640 1 Processor -- start 2024-08-17T02:30:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 -- start start 2024-08-17T02:30:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c0a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a4c0add30 0x7f7a4c0a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c0a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c15c150 con 0x7f7a4c0ca050 2024-08-17T02:30:48.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0a5960 con 0x7f7a4c0ad960 2024-08-17T02:30:48.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.939+0000 7f7a52400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c15b820 con 0x7f7a4c0add30 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c0a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c0a4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48010/0 (socket says 172.21.15.42:48010) 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 -- 172.21.15.42:0/3016183893 learned_addr learned my addr 172.21.15.42:0/3016183893 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4b400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c0a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4aa00640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a4c0add30 0x7f7a4c0a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 -- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a4c0add30 msgr2=0x7f7a4c0a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a4c0add30 0x7f7a4c0a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 -- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 msgr2=0x7f7a4c0a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c0a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4be00640 1 -- 172.21.15.42:0/3016183893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c009390 con 0x7f7a4c0ca050 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.940+0000 7f7a4b400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c0a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.941+0000 7f7a4be00640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c0a4e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c910 tx=0x7f7a440026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.941+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400cea0 con 0x7f7a4c0ca050 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.941+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4400a850 con 0x7f7a4c0ca050 2024-08-17T02:30:48.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.941+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400ac70 con 0x7f7a4c0ca050 2024-08-17T02:30:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.941+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c15bb00 con 0x7f7a4c0ca050 2024-08-17T02:30:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.941+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c15e490 con 0x7f7a4c0ca050 2024-08-17T02:30:48.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.942+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c063fb0 con 0x7f7a4c0ca050 2024-08-17T02:30:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.943+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a44012630 con 0x7f7a4c0ca050 2024-08-17T02:30:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.944+0000 7f7a42a00640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7a2c065150 0x7f7a2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.944+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7a44082400 con 0x7f7a4c0ca050 2024-08-17T02:30:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.944+0000 7f7a4b400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7a2c065150 0x7f7a2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.945+0000 7f7a4b400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7a2c065150 0x7f7a2c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c034000 tx=0x7f7a3c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:48.948+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a44050770 con 0x7f7a4c0ca050 2024-08-17T02:30:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.129+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a4c0acd10 con 0x7f7a4c0ca050 2024-08-17T02:30:49.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.130+0000 7f7a42a00640 1 -- 172.21.15.42:0/3016183893 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12345 (secure 0 0 0) 0x7f7a44053d90 con 0x7f7a4c0ca050 2024-08-17T02:30:49.131 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:49.131 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":43,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:30:45.724771+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6835/4011881108":"2024-08-18T02:30:42.540409+0000","172.21.15.62:6833/4011881108":"2024-08-18T02:30:42.540409+0000","172.21.15.42:6836/3869657839":"2024-08-18T02:30:35.671511+0000","172.21.15.42:6834/3869657839":"2024-08-18T02:30:35.671511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7a2c065150 msgr2=0x7f7a2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7a2c065150 0x7f7a2c067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c034000 tx=0x7f7a3c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:49.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 msgr2=0x7f7a4c0a4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c0a4e90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c910 tx=0x7f7a440026f0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 shutdown_connections 2024-08-17T02:30:49.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7a2c065150 0x7f7a2c067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a4c0ca050 0x7f7a4c0a4e90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7a4c0add30 0x7f7a4c0a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 --2- 172.21.15.42:0/3016183893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a4c0ad960 0x7f7a4c0a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 >> 172.21.15.42:0/3016183893 conn(0x7f7a4c066e60 msgr2=0x7f7a4c0abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 shutdown_connections 2024-08-17T02:30:49.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.132+0000 7f7a52400640 1 -- 172.21.15.42:0/3016183893 wait complete. 2024-08-17T02:30:49.149 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:30:49.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.301+0000 7f1429a00640 1 Processor -- start 2024-08-17T02:30:49.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.301+0000 7f1429a00640 1 -- start start 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1429a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155910 0x7f14240ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1429a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f14240ade20 0x7f14240ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1429a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1424155ce0 0x7f14240aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1429a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14240c97c0 con 0x7f1424155ce0 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1429a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14240ae3a0 con 0x7f14240ade20 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1429a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14240c9170 con 0x7f1424155910 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1424155ce0 0x7f14240aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1424155ce0 0x7f14240aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48022/0 (socket says 172.21.15.42:48022) 2024-08-17T02:30:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 -- 172.21.15.42:0/1184300482 learned_addr learned my addr 172.21.15.42:0/1184300482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1422a00640 1 --2- 172.21.15.42:0/1184300482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155910 0x7f14240ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1422000640 1 --2- 172.21.15.42:0/1184300482 >> v2:172.21.15.62:3300/0 conn(0x7f14240ade20 0x7f14240ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 -- 172.21.15.42:0/1184300482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155910 msgr2=0x7f14240ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 --2- 172.21.15.42:0/1184300482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155910 0x7f14240ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 -- 172.21.15.42:0/1184300482 >> v2:172.21.15.62:3300/0 conn(0x7f14240ade20 msgr2=0x7f14240ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 --2- 172.21.15.42:0/1184300482 >> v2:172.21.15.62:3300/0 conn(0x7f14240ade20 0x7f14240ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.303+0000 7f1423400640 1 -- 172.21.15.42:0/1184300482 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240c9450 con 0x7f1424155ce0 2024-08-17T02:30:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.304+0000 7f1423400640 1 --2- 172.21.15.42:0/1184300482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155ce0 0x7f14240aee10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f142406cd90 tx=0x7f141c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6528f843351b622 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1421600640 1 -- 172.21.15.42:0/1184300482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c033430 con 0x7f1424155ce0 2024-08-17T02:30:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1421600640 1 -- 172.21.15.42:0/1184300482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c033590 con 0x7f1424155ce0 2024-08-17T02:30:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1421600640 1 -- 172.21.15.42:0/1184300482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c033970 con 0x7f1424155ce0 2024-08-17T02:30:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 -- 172.21.15.42:0/1184300482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155ce0 msgr2=0x7f14240aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 --2- 172.21.15.42:0/1184300482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155ce0 0x7f14240aee10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f142406cd90 tx=0x7f141c009840 comp rx=0 tx=0).stop 2024-08-17T02:30:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 -- 172.21.15.42:0/1184300482 shutdown_connections 2024-08-17T02:30:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 --2- 172.21.15.42:0/1184300482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155ce0 0x7f14240aee10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 --2- 172.21.15.42:0/1184300482 >> v2:172.21.15.62:3300/0 conn(0x7f14240ade20 0x7f14240ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 --2- 172.21.15.42:0/1184300482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155910 0x7f14240ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 -- 172.21.15.42:0/1184300482 >> 172.21.15.42:0/1184300482 conn(0x7f1424066e60 msgr2=0x7f1424067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.305+0000 7f1429a00640 1 -- 172.21.15.42:0/1184300482 shutdown_connections 2024-08-17T02:30:49.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.306+0000 7f1429a00640 1 -- 172.21.15.42:0/1184300482 wait complete. 2024-08-17T02:30:49.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.307+0000 7f1429a00640 1 Processor -- start 2024-08-17T02:30:49.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.307+0000 7f1429a00640 1 -- start start 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1429a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 0x7f1424152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1429a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 0x7f14240aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1429a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155ce0 0x7f14240a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1429a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240a88e0 con 0x7f1424155910 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1429a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240a8bc0 con 0x7f14240ade20 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1429a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1424153310 con 0x7f1424155ce0 2024-08-17T02:30:49.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1422000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 0x7f14240aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1422a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 0x7f1424152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1422000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 0x7f14240aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48032/0 (socket says 172.21.15.42:48032) 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1422a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 0x7f1424152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.42:48538/0 (socket says 172.21.15.42:48538) 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1422000640 1 -- 172.21.15.42:0/1500808974 learned_addr learned my addr 172.21.15.42:0/1500808974 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.308+0000 7f1423400640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155ce0 0x7f14240a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422000640 1 -- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155ce0 msgr2=0x7f14240a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422000640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155ce0 0x7f14240a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422000640 1 -- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 msgr2=0x7f1424152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422000640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 0x7f1424152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422000640 1 -- 172.21.15.42:0/1500808974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009ae0 con 0x7f1424155910 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 0x7f1424152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1422000640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 0x7f14240aa5d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f141000e930 tx=0x7f14100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000c8e0 con 0x7f1424155910 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141000ca40 con 0x7f1424155910 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000cde0 con 0x7f1424155910 2024-08-17T02:30:49.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14241535f0 con 0x7f1424155910 2024-08-17T02:30:49.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.309+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1424153000 con 0x7f1424155910 2024-08-17T02:30:49.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.311+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1424063fb0 con 0x7f1424155910 2024-08-17T02:30:49.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.311+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1410013680 con 0x7f1424155910 2024-08-17T02:30:49.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.312+0000 7f141a000640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1404065150 0x7f1404067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.312+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1410082340 con 0x7f1424155910 2024-08-17T02:30:49.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.312+0000 7f1422a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1404065150 0x7f1404067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.313+0000 7f1422a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1404065150 0x7f1404067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14140113e0 tx=0x7f14140090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.316+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1410050770 con 0x7f1424155910 2024-08-17T02:30:49.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.499+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14240ada90 con 0x7f1404065150 2024-08-17T02:30:49.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.501+0000 7f141a000640 1 -- 172.21.15.42:0/1500808974 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50758 (secure 0 0 0) 0x7f14240ada90 con 0x7f1404065150 2024-08-17T02:30:49.503 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:49.504 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:30:49.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.503+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1404065150 msgr2=0x7f1404067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.503+0000 7f1429a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1404065150 0x7f1404067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14140113e0 tx=0x7f14140090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.503+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 msgr2=0x7f14240aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.503+0000 7f1429a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 0x7f14240aa5d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f141000e930 tx=0x7f14100090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 shutdown_connections 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1404065150 0x7f1404067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1424155ce0 0x7f14240a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1424155910 0x7f14240aa5d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 --2- 172.21.15.42:0/1500808974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f14240ade20 0x7f1424152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 >> 172.21.15.42:0/1500808974 conn(0x7f1424066e60 msgr2=0x7f14240ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 shutdown_connections 2024-08-17T02:30:49.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.504+0000 7f1429a00640 1 -- 172.21.15.42:0/1500808974 wait complete. 2024-08-17T02:30:49.520 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:30:49.234117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400684,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574036,"statfs":{"total":773094113280,"available":770635812864,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.690958"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:30:44.867773+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:30:44.867773+0000","last_peered":"2024-08-17T02:30:44.867773+0000","last_clean":"2024-08-17T02:30:44.867773+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:30:44.867773+0000","last_undegraded":"2024-08-17T02:30:44.867773+0000","last_fullsized":"2024-08-17T02:30:44.867773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94099999999999995,"5min":2.097,"15min":2.097},"last":0.499}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.67100000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59399999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96799999999999997,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70699999999999996,"15min":0.68500000000000005},"min":{"1min":0.67700000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.67500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.016,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.76700000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1,"5min":1.155,"15min":1.155},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.90800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.093,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.873,"5min":1.885,"15min":1.885},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":1.964,"15min":1.964},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86899999999999999,"15min":0.91500000000000004},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.97199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.93899999999999995,"15min":1.0229999999999999},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":8.4610000000000003,"15min":8.4610000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.117,"15min":1.27},"min":{"1min":0.57299999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99199999999999999,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.79000000000000004,"15min":0.85799999999999998},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71299999999999997,"15min":0.753},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":4.548,"15min":4.548},"last":0.93600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89300000000000002,"15min":0.97499999999999998},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.749,"5min":0.79600000000000004,"15min":0.82399999999999995},"min":{"1min":0.55900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0620000000000001,"5min":1.931,"15min":1.931},"last":0.98599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.98299999999999998,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.96499999999999997,"15min":1.079},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94699999999999995,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.024},"min":{"1min":0.53100000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":6.8970000000000002,"15min":6.8970000000000002},"last":0.438},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.89800000000000002,"15min":0.96799999999999997},"min":{"1min":0.51700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0089999999999999,"15min":1.1259999999999999},"min":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":11.622,"15min":11.622},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.02,"15min":1.1439999999999999},"min":{"1min":0.496,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.98399999999999999,"15min":1.087},"min":{"1min":0.56000000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":9.6419999999999995,"15min":9.6419999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.98899999999999999,"15min":1.0860000000000001},"min":{"1min":0.61599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96799999999999997,"5min":6.7309999999999999,"15min":6.7309999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.82899999999999996,"15min":0.94499999999999995},"min":{"1min":0.42299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.77200000000000002,"15min":0.85699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92700000000000005,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.95099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.86099999999999999,"15min":0.95199999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":5.242,"15min":5.242},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":1.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.621,"15min":1.621},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.92800000000000005,"15min":1.028},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.65900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.86099999999999999},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0369999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.64100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.048,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":0.999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.627,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.23,"15min":1.23},"last":0.71799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.59099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99299999999999999,"5min":1.202,"15min":1.202},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":1.171,"15min":1.171},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81699999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84199999999999997,"5min":1.175,"15min":1.175},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":1.149,"15min":1.149},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.876,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.0109999999999999,"15min":1.258},"min":{"1min":0.317,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69099999999999995,"5min":17.771000000000001,"15min":17.771000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.0489999999999999,"15min":1.3029999999999999},"min":{"1min":0.34100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":18.603999999999999,"15min":18.603999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.02,"15min":1.258},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.0740000000000001,"15min":1.2689999999999999},"min":{"1min":0.499,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":15.847,"15min":15.847},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.135,"15min":1.3879999999999999},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":19.356999999999999,"15min":19.356999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.115,"15min":1.3340000000000001},"min":{"1min":0.44400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83399999999999996,"5min":16.975999999999999,"15min":16.975999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.99099999999999999,"15min":1.1020000000000001},"min":{"1min":0.57799999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.997,"5min":8.8320000000000007,"15min":8.8320000000000007},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.997,"15min":1.1040000000000001},"min":{"1min":0.57599999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.052,"5min":8.6509999999999998,"15min":8.6509999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.2370000000000001,"15min":1.4319999999999999},"min":{"1min":0.56699999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.999,"5min":15.153,"15min":15.153},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.0780000000000001,"15min":1.2170000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0660000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.0009999999999999,"15min":1.1040000000000001},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93000000000000005,"5min":7.9870000000000001,"15min":7.9870000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":1.0740000000000001},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.085,"5min":7.2629999999999999,"15min":7.2629999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0289999999999999,"5min":1.99,"15min":1.99},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.625,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1100000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.75,"15min":0.75},"last":0.496}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.436,"15min":0.433},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.60599999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0620000000000001,"5min":1.099,"15min":1.099},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76500000000000001,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.123,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.198,"15min":1.198},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.131,"15min":1.131},"last":0.876}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80300000000000005,"15min":0.78900000000000003},"min":{"1min":0.67700000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86199999999999999,"5min":1.179,"15min":1.179},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.286,"15min":1.286},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.069,"15min":1.069},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.81100000000000005},"min":{"1min":0.63600000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.222,"15min":1.222},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.044,"5min":1.242,"15min":1.242},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98299999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.997,"5min":1.246,"15min":1.246},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63800000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77600000000000002,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58899999999999997,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76100000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":0.38},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82299999999999995,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.68700000000000006}]},{"osd":4,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82699999999999996,"15min":0.85499999999999998},"min":{"1min":0.58699999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94599999999999995,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.042,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0700000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.625},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.046,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.65300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.87,"15min":0.91500000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90900000000000003,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:49.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:49.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.673+0000 7fae77e00640 1 Processor -- start 2024-08-17T02:30:49.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.674+0000 7fae77e00640 1 -- start start 2024-08-17T02:30:49.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae77e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fae78158c60 0x7fae7815a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae77e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fae78159030 0x7fae780ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae77e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7815b6b0 con 0x7fae780b1920 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae77e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780b0540 con 0x7fae78158c60 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae77e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7815aac0 con 0x7fae78159030 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae76a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fae78158c60 0x7fae7815a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae76a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fae78158c60 0x7fae7815a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48036/0 (socket says 172.21.15.42:48036) 2024-08-17T02:30:49.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae76a00640 1 -- 172.21.15.42:0/706592468 learned_addr learned my addr 172.21.15.42:0/706592468 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:49.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae6fe00640 1 --2- 172.21.15.42:0/706592468 >> v2:172.21.15.62:3300/0 conn(0x7fae78159030 0x7fae780ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae76a00640 1 -- 172.21.15.42:0/706592468 >> v2:172.21.15.62:3300/0 conn(0x7fae78159030 msgr2=0x7fae780ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:49.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae76a00640 1 --2- 172.21.15.42:0/706592468 >> v2:172.21.15.62:3300/0 conn(0x7fae78159030 0x7fae780ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.675+0000 7fae76a00640 1 -- 172.21.15.42:0/706592468 >> v1:172.21.15.62:6789/0 conn(0x7fae780b1920 legacy=0x7fae780b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.676+0000 7fae76a00640 1 -- 172.21.15.42:0/706592468 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7815ad80 con 0x7fae78158c60 2024-08-17T02:30:49.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae76a00640 1 --2- 172.21.15.42:0/706592468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae7815a490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fae780cd4d0 tx=0x7fae680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcf26dd1ec4f4c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae76000640 1 -- 172.21.15.42:0/706592468 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6802ae80 con 0x7fae78158c60 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae76000640 1 -- 172.21.15.42:0/706592468 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68032440 con 0x7fae78158c60 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae76000640 1 -- 172.21.15.42:0/706592468 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68032800 con 0x7fae78158c60 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae77e00640 1 -- 172.21.15.42:0/706592468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 msgr2=0x7fae7815a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae77e00640 1 --2- 172.21.15.42:0/706592468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae7815a490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fae780cd4d0 tx=0x7fae680091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae77e00640 1 -- 172.21.15.42:0/706592468 shutdown_connections 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae77e00640 1 --2- 172.21.15.42:0/706592468 >> v2:172.21.15.62:3300/0 conn(0x7fae78159030 0x7fae780ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae77e00640 1 --2- 172.21.15.42:0/706592468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae7815a490 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.677+0000 7fae77e00640 1 -- 172.21.15.42:0/706592468 >> 172.21.15.42:0/706592468 conn(0x7fae7806e590 msgr2=0x7fae7806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.678+0000 7fae77e00640 1 -- 172.21.15.42:0/706592468 shutdown_connections 2024-08-17T02:30:49.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.678+0000 7fae77e00640 1 -- 172.21.15.42:0/706592468 wait complete. 2024-08-17T02:30:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.679+0000 7fae77e00640 1 Processor -- start 2024-08-17T02:30:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.679+0000 7fae77e00640 1 -- start start 2024-08-17T02:30:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae780b1920 0x7fae7815f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae780b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae78159030 0x7fae780b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7815f8b0 con 0x7fae78158c60 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c7ee0 con 0x7fae780b1920 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c75f0 con 0x7fae78159030 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae780b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae780b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48050/0 (socket says 172.21.15.42:48050) 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae6fe00640 1 -- 172.21.15.42:0/235458433 learned_addr learned my addr 172.21.15.42:0/235458433 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae76a00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae780b1920 0x7fae7815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.680+0000 7fae77400640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae78159030 0x7fae780b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6fe00640 1 -- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae78159030 msgr2=0x7fae780b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6fe00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae78159030 0x7fae780b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6fe00640 1 -- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae780b1920 msgr2=0x7fae7815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6fe00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae780b1920 0x7fae7815f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6fe00640 1 -- 172.21.15.42:0/235458433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68009450 con 0x7fae78158c60 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6fe00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae780b4030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fae6000d890 tx=0x7fae60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000de20 con 0x7fae78158c60 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000b8d0 con 0x7fae78158c60 2024-08-17T02:30:49.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000bc90 con 0x7fae78158c60 2024-08-17T02:30:49.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae780c7890 con 0x7fae78158c60 2024-08-17T02:30:49.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.681+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae780c43d0 con 0x7fae78158c60 2024-08-17T02:30:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.682+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae780c8070 con 0x7fae78158c60 2024-08-17T02:30:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.683+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fae6001e460 con 0x7fae78158c60 2024-08-17T02:30:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.684+0000 7fae6e000640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fae54065150 0x7fae54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.685+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fae60082750 con 0x7fae78158c60 2024-08-17T02:30:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.685+0000 7fae76a00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fae54065150 0x7fae54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.685+0000 7fae76a00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fae54065150 0x7fae54067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fae68034000 tx=0x7fae68032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.689+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fae60050b40 con 0x7fae78158c60 2024-08-17T02:30:49.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.869+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae78070720 con 0x7fae54065150 2024-08-17T02:30:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.871+0000 7fae6e000640 1 -- 172.21.15.42:0/235458433 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50758 (secure 0 0 0) 0x7fae78070720 con 0x7fae54065150 2024-08-17T02:30:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:49.873 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:30:49.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fae54065150 msgr2=0x7fae54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fae54065150 0x7fae54067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fae68034000 tx=0x7fae68032000 comp rx=0 tx=0).stop 2024-08-17T02:30:49.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 msgr2=0x7fae780b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae780b4030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fae6000d890 tx=0x7fae60008040 comp rx=0 tx=0).stop 2024-08-17T02:30:49.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 shutdown_connections 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fae54065150 0x7fae54067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae78159030 0x7fae780b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae78158c60 0x7fae780b4030 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 --2- 172.21.15.42:0/235458433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae780b1920 0x7fae7815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.873+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 >> 172.21.15.42:0/235458433 conn(0x7fae7806e590 msgr2=0x7fae78157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.874+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 shutdown_connections 2024-08-17T02:30:49.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:49.874+0000 7fae77e00640 1 -- 172.21.15.42:0/235458433 wait complete. 2024-08-17T02:30:49.890 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:30:49.234117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400684,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574036,"statfs":{"total":773094113280,"available":770635812864,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.690958"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:30:44.867773+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:30:44.867773+0000","last_peered":"2024-08-17T02:30:44.867773+0000","last_clean":"2024-08-17T02:30:44.867773+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:30:44.867773+0000","last_undegraded":"2024-08-17T02:30:44.867773+0000","last_fullsized":"2024-08-17T02:30:44.867773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94099999999999995,"5min":2.097,"15min":2.097},"last":0.499}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.67100000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59399999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96799999999999997,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70699999999999996,"15min":0.68500000000000005},"min":{"1min":0.67700000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.67500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.016,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.76700000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1,"5min":1.155,"15min":1.155},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.90800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.093,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.873,"5min":1.885,"15min":1.885},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":1.964,"15min":1.964},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86899999999999999,"15min":0.91500000000000004},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.97199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.93899999999999995,"15min":1.0229999999999999},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":8.4610000000000003,"15min":8.4610000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.117,"15min":1.27},"min":{"1min":0.57299999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99199999999999999,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.79000000000000004,"15min":0.85799999999999998},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71299999999999997,"15min":0.753},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":4.548,"15min":4.548},"last":0.93600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89300000000000002,"15min":0.97499999999999998},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.749,"5min":0.79600000000000004,"15min":0.82399999999999995},"min":{"1min":0.55900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0620000000000001,"5min":1.931,"15min":1.931},"last":0.98599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.98299999999999998,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.96499999999999997,"15min":1.079},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94699999999999995,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.024},"min":{"1min":0.53100000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":6.8970000000000002,"15min":6.8970000000000002},"last":0.438},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.89800000000000002,"15min":0.96799999999999997},"min":{"1min":0.51700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0089999999999999,"15min":1.1259999999999999},"min":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":11.622,"15min":11.622},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.02,"15min":1.1439999999999999},"min":{"1min":0.496,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.98399999999999999,"15min":1.087},"min":{"1min":0.56000000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":9.6419999999999995,"15min":9.6419999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.98899999999999999,"15min":1.0860000000000001},"min":{"1min":0.61599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96799999999999997,"5min":6.7309999999999999,"15min":6.7309999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.82899999999999996,"15min":0.94499999999999995},"min":{"1min":0.42299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.77200000000000002,"15min":0.85699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92700000000000005,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.95099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.86099999999999999,"15min":0.95199999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":5.242,"15min":5.242},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":1.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.621,"15min":1.621},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.92800000000000005,"15min":1.028},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.65900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.86099999999999999},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0369999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.64100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.048,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":0.999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.627,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.23,"15min":1.23},"last":0.71799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.59099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99299999999999999,"5min":1.202,"15min":1.202},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":1.171,"15min":1.171},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81699999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84199999999999997,"5min":1.175,"15min":1.175},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":1.149,"15min":1.149},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.876,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.0109999999999999,"15min":1.258},"min":{"1min":0.317,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69099999999999995,"5min":17.771000000000001,"15min":17.771000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.0489999999999999,"15min":1.3029999999999999},"min":{"1min":0.34100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":18.603999999999999,"15min":18.603999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.02,"15min":1.258},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.0740000000000001,"15min":1.2689999999999999},"min":{"1min":0.499,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":15.847,"15min":15.847},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.135,"15min":1.3879999999999999},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":19.356999999999999,"15min":19.356999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.115,"15min":1.3340000000000001},"min":{"1min":0.44400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83399999999999996,"5min":16.975999999999999,"15min":16.975999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.99099999999999999,"15min":1.1020000000000001},"min":{"1min":0.57799999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.997,"5min":8.8320000000000007,"15min":8.8320000000000007},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.997,"15min":1.1040000000000001},"min":{"1min":0.57599999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.052,"5min":8.6509999999999998,"15min":8.6509999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.2370000000000001,"15min":1.4319999999999999},"min":{"1min":0.56699999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.999,"5min":15.153,"15min":15.153},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.0780000000000001,"15min":1.2170000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0660000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.0009999999999999,"15min":1.1040000000000001},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93000000000000005,"5min":7.9870000000000001,"15min":7.9870000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":1.0740000000000001},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.085,"5min":7.2629999999999999,"15min":7.2629999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0289999999999999,"5min":1.99,"15min":1.99},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.625,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1100000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.75,"15min":0.75},"last":0.496}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.436,"15min":0.433},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.60599999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0620000000000001,"5min":1.099,"15min":1.099},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76500000000000001,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.123,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.198,"15min":1.198},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.131,"15min":1.131},"last":0.876}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80300000000000005,"15min":0.78900000000000003},"min":{"1min":0.67700000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86199999999999999,"5min":1.179,"15min":1.179},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.286,"15min":1.286},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.069,"15min":1.069},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.81100000000000005},"min":{"1min":0.63600000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.222,"15min":1.222},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.044,"5min":1.242,"15min":1.242},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98299999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.997,"5min":1.246,"15min":1.246},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63800000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77600000000000002,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58899999999999997,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76100000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":0.38},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82299999999999995,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.68700000000000006}]},{"osd":4,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82699999999999996,"15min":0.85499999999999998},"min":{"1min":0.58699999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94599999999999995,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.042,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0700000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.625},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.046,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.65300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.87,"15min":0.91500000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90900000000000003,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:49.892 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:30:49.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:50.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.043+0000 7f95d3600640 1 Processor -- start 2024-08-17T02:30:50.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.043+0000 7f95d3600640 1 -- start start 2024-08-17T02:30:50.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.044+0000 7f95d3600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f95cc0ad960 0x7f95cc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.044+0000 7f95d3600640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95cc0add30 0x7f95cc156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.044+0000 7f95d3600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc15b5e0 con 0x7f95cc0ca050 2024-08-17T02:30:50.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.044+0000 7f95d3600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0cb160 con 0x7f95cc0ad960 2024-08-17T02:30:50.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.044+0000 7f95d3600640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0b0d10 con 0x7f95cc0add30 2024-08-17T02:30:50.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f95cc0ad960 0x7f95cc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f95cc0ad960 0x7f95cc15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48058/0 (socket says 172.21.15.42:48058) 2024-08-17T02:30:50.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 -- 172.21.15.42:0/3358032162 learned_addr learned my addr 172.21.15.42:0/3358032162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:50.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 -- 172.21.15.42:0/3358032162 >> v2:172.21.15.62:3300/0 conn(0x7f95cc0add30 msgr2=0x7f95cc156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:50.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 --2- 172.21.15.42:0/3358032162 >> v2:172.21.15.62:3300/0 conn(0x7f95cc0add30 0x7f95cc156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 -- 172.21.15.42:0/3358032162 >> v1:172.21.15.62:6789/0 conn(0x7f95cc0ca050 legacy=0x7f95cc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:50.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.045+0000 7f95d0c00640 1 -- 172.21.15.42:0/3358032162 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0ca550 con 0x7f95cc0ad960 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.046+0000 7f95d0c00640 1 --2- 172.21.15.42:0/3358032162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0ad960 0x7f95cc15b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0cb0d0 tx=0x7f95c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafdc27667e0ad58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.046+0000 7f95cb400640 1 -- 172.21.15.42:0/3358032162 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c002ae70 con 0x7f95cc0ad960 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.046+0000 7f95cb400640 1 -- 172.21.15.42:0/3358032162 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0032440 con 0x7f95cc0ad960 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.046+0000 7f95cb400640 1 -- 172.21.15.42:0/3358032162 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0032820 con 0x7f95cc0ad960 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 -- 172.21.15.42:0/3358032162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0ad960 msgr2=0x7f95cc15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 --2- 172.21.15.42:0/3358032162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0ad960 0x7f95cc15b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0cb0d0 tx=0x7f95c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 -- 172.21.15.42:0/3358032162 shutdown_connections 2024-08-17T02:30:50.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 --2- 172.21.15.42:0/3358032162 >> v2:172.21.15.62:3300/0 conn(0x7f95cc0add30 0x7f95cc156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 --2- 172.21.15.42:0/3358032162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0ad960 0x7f95cc15b0a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 -- 172.21.15.42:0/3358032162 >> 172.21.15.42:0/3358032162 conn(0x7f95cc066e60 msgr2=0x7f95cc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:50.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 -- 172.21.15.42:0/3358032162 shutdown_connections 2024-08-17T02:30:50.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.047+0000 7f95d3600640 1 -- 172.21.15.42:0/3358032162 wait complete. 2024-08-17T02:30:50.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.048+0000 7f95d3600640 1 Processor -- start 2024-08-17T02:30:50.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.048+0000 7f95d3600640 1 -- start start 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.049+0000 7f95d3600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0ad960 0x7f95cc144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.049+0000 7f95d3600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 0x7f95cc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.049+0000 7f95d3600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0ca050 0x7f95cc156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.049+0000 7f95d3600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc144950 con 0x7f95cc0add30 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.049+0000 7f95d3600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc06aed0 con 0x7f95cc0ca050 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.049+0000 7f95d3600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc16d630 con 0x7f95cc0ad960 2024-08-17T02:30:50.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 0x7f95cc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 0x7f95cc1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48066/0 (socket says 172.21.15.42:48066) 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 -- 172.21.15.42:0/805766326 learned_addr learned my addr 172.21.15.42:0/805766326 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95d0c00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0ad960 0x7f95cc144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95d1600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0ca050 0x7f95cc156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 -- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0ad960 msgr2=0x7f95cc144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0ad960 0x7f95cc144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 -- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0ca050 msgr2=0x7f95cc156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0ca050 0x7f95cc156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 -- 172.21.15.42:0/805766326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0009450 con 0x7f95cc0add30 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.050+0000 7f95cbe00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 0x7f95cc1561f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b5e0 tx=0x7f95b80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.051+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800f590 con 0x7f95cc0add30 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.051+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b800f710 con 0x7f95cc0add30 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.051+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800fad0 con 0x7f95cc0add30 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.051+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc06a880 con 0x7f95cc0add30 2024-08-17T02:30:50.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.051+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc06b360 con 0x7f95cc0add30 2024-08-17T02:30:50.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.052+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc06a6e0 con 0x7f95cc0add30 2024-08-17T02:30:50.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.053+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95b801a460 con 0x7f95cc0add30 2024-08-17T02:30:50.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.053+0000 7f95bfe00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f95ac065150 0x7f95ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.054+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f95b8081cc0 con 0x7f95cc0add30 2024-08-17T02:30:50.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.054+0000 7f95d0c00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f95ac065150 0x7f95ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.055+0000 7f95d0c00640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f95ac065150 0x7f95ac067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95c0034000 tx=0x7f95c0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.058+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95cc06a6e0 con 0x7f95cc0add30 2024-08-17T02:30:50.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.240+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95cc06a6e0 con 0x7f95ac065150 2024-08-17T02:30:50.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.242+0000 7f95bfe00640 1 -- 172.21.15.42:0/805766326 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50758 (secure 0 0 0) 0x7f95cc06a6e0 con 0x7f95ac065150 2024-08-17T02:30:50.244 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:50.244 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:30:50.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f95ac065150 msgr2=0x7f95ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f95ac065150 0x7f95ac067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95c0034000 tx=0x7f95c0032000 comp rx=0 tx=0).stop 2024-08-17T02:30:50.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 msgr2=0x7f95cc1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 0x7f95cc1561f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b5e0 tx=0x7f95b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 shutdown_connections 2024-08-17T02:30:50.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f95ac065150 0x7f95ac067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95cc0ca050 0x7f95cc156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc0add30 0x7f95cc1561f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 --2- 172.21.15.42:0/805766326 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95cc0ad960 0x7f95cc144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 >> 172.21.15.42:0/805766326 conn(0x7f95cc066e60 msgr2=0x7f95cc1548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:50.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.244+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 shutdown_connections 2024-08-17T02:30:50.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.245+0000 7f95d3600640 1 -- 172.21.15.42:0/805766326 wait complete. 2024-08-17T02:30:50.262 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-08-17T02:30:49.234117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400684,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574036,"statfs":{"total":773094113280,"available":770635812864,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.690958"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:30:44.867773+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:30:44.867773+0000","last_peered":"2024-08-17T02:30:44.867773+0000","last_clean":"2024-08-17T02:30:44.867773+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:30:44.867773+0000","last_undegraded":"2024-08-17T02:30:44.867773+0000","last_fullsized":"2024-08-17T02:30:44.867773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94099999999999995,"5min":2.097,"15min":2.097},"last":0.499}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.67100000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59399999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96799999999999997,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70699999999999996,"15min":0.68500000000000005},"min":{"1min":0.67700000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.67500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.016,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.76700000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1,"5min":1.155,"15min":1.155},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.90800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.093,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.89400000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.873,"5min":1.885,"15min":1.885},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":1.964,"15min":1.964},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86899999999999999,"15min":0.91500000000000004},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.97199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.93899999999999995,"15min":1.0229999999999999},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":8.4610000000000003,"15min":8.4610000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.117,"15min":1.27},"min":{"1min":0.57299999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99199999999999999,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.79000000000000004,"15min":0.85799999999999998},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71299999999999997,"15min":0.753},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":4.548,"15min":4.548},"last":0.93600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89300000000000002,"15min":0.97499999999999998},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.749,"5min":0.79600000000000004,"15min":0.82399999999999995},"min":{"1min":0.55900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0620000000000001,"5min":1.931,"15min":1.931},"last":0.98599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.98299999999999998,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.96499999999999997,"15min":1.079},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94699999999999995,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.024},"min":{"1min":0.53100000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":6.8970000000000002,"15min":6.8970000000000002},"last":0.438},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.89800000000000002,"15min":0.96799999999999997},"min":{"1min":0.51700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0089999999999999,"15min":1.1259999999999999},"min":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":11.622,"15min":11.622},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.02,"15min":1.1439999999999999},"min":{"1min":0.496,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.98399999999999999,"15min":1.087},"min":{"1min":0.56000000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":9.6419999999999995,"15min":9.6419999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.98899999999999999,"15min":1.0860000000000001},"min":{"1min":0.61599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96799999999999997,"5min":6.7309999999999999,"15min":6.7309999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.82899999999999996,"15min":0.94499999999999995},"min":{"1min":0.42299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.77200000000000002,"15min":0.85699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92700000000000005,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.95099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.86099999999999999,"15min":0.95199999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":5.242,"15min":5.242},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":1.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.621,"15min":1.621},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.92800000000000005,"15min":1.028},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.76900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.65900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.86099999999999999},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0369999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.64100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.048,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":0.999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.627,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.23,"15min":1.23},"last":0.71799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.59099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99299999999999999,"5min":1.202,"15min":1.202},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":1.171,"15min":1.171},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81699999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84199999999999997,"5min":1.175,"15min":1.175},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":1.149,"15min":1.149},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.876,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.48699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.0109999999999999,"15min":1.258},"min":{"1min":0.317,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69099999999999995,"5min":17.771000000000001,"15min":17.771000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.0489999999999999,"15min":1.3029999999999999},"min":{"1min":0.34100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":18.603999999999999,"15min":18.603999999999999},"last":0.43099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.02,"15min":1.258},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.0740000000000001,"15min":1.2689999999999999},"min":{"1min":0.499,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":15.847,"15min":15.847},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.135,"15min":1.3879999999999999},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":19.356999999999999,"15min":19.356999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.115,"15min":1.3340000000000001},"min":{"1min":0.44400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83399999999999996,"5min":16.975999999999999,"15min":16.975999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.99099999999999999,"15min":1.1020000000000001},"min":{"1min":0.57799999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.997,"5min":8.8320000000000007,"15min":8.8320000000000007},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.997,"15min":1.1040000000000001},"min":{"1min":0.57599999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.052,"5min":8.6509999999999998,"15min":8.6509999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.2370000000000001,"15min":1.4319999999999999},"min":{"1min":0.56699999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.999,"5min":15.153,"15min":15.153},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.0780000000000001,"15min":1.2170000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0660000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.0009999999999999,"15min":1.1040000000000001},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93000000000000005,"5min":7.9870000000000001,"15min":7.9870000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":1.0740000000000001},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.085,"5min":7.2629999999999999,"15min":7.2629999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0289999999999999,"5min":1.99,"15min":1.99},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.625,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1100000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.64400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.75,"15min":0.75},"last":0.496}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.436,"15min":0.433},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56799999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60199999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.60599999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0620000000000001,"5min":1.099,"15min":1.099},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76500000000000001,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.123,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.198,"15min":1.198},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.131,"15min":1.131},"last":0.876}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80300000000000005,"15min":0.78900000000000003},"min":{"1min":0.67700000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.80300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86199999999999999,"5min":1.179,"15min":1.179},"last":0.53000000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.286,"15min":1.286},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.069,"15min":1.069},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.81100000000000005},"min":{"1min":0.63600000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.222,"15min":1.222},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.044,"5min":1.242,"15min":1.242},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98299999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.997,"5min":1.246,"15min":1.246},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63800000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77600000000000002,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58899999999999997,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76100000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":0.38},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82299999999999995,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.68700000000000006}]},{"osd":4,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82699999999999996,"15min":0.85499999999999998},"min":{"1min":0.58699999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94599999999999995,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.042,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0700000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.625},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.046,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.65300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.87,"15min":0.91500000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90900000000000003,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:50.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:50.278 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:50.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:50.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.418+0000 7f86f7a00640 1 Processor -- start 2024-08-17T02:30:50.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.418+0000 7f86f7a00640 1 -- start start 2024-08-17T02:30:50.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.419+0000 7f86f7a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f86f00cc220 0x7f86f00c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.419+0000 7f86f7a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f86f00cc630 0x7f86f00c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.419+0000 7f86f7a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f00c4bb0 con 0x7f86f00b0040 2024-08-17T02:30:50.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.419+0000 7f86f7a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f00c8c10 con 0x7f86f00cc220 2024-08-17T02:30:50.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.419+0000 7f86f7a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f0157230 con 0x7f86f00cc630 2024-08-17T02:30:50.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f86f00cc220 0x7f86f00c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f86f00cc220 0x7f86f00c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48082/0 (socket says 172.21.15.42:48082) 2024-08-17T02:30:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 -- 172.21.15.42:0/3939567652 learned_addr learned my addr 172.21.15.42:0/3939567652 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86f5a00640 1 --2- 172.21.15.42:0/3939567652 >> v2:172.21.15.62:3300/0 conn(0x7f86f00cc630 0x7f86f00c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 -- 172.21.15.42:0/3939567652 >> v2:172.21.15.62:3300/0 conn(0x7f86f00cc630 msgr2=0x7f86f00c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 --2- 172.21.15.42:0/3939567652 >> v2:172.21.15.62:3300/0 conn(0x7f86f00cc630 0x7f86f00c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 -- 172.21.15.42:0/3939567652 >> v1:172.21.15.62:6789/0 conn(0x7f86f00b0040 legacy=0x7f86f00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.420+0000 7f86efe00640 1 -- 172.21.15.42:0/3939567652 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0087070 con 0x7f86f00cc220 2024-08-17T02:30:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.421+0000 7f86efe00640 1 --2- 172.21.15.42:0/3939567652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc220 0x7f86f00c90a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f86f006f3b0 tx=0x7f86dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37075bd82c2111d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86ef400640 1 -- 172.21.15.42:0/3939567652 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc02ae80 con 0x7f86f00cc220 2024-08-17T02:30:50.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86ef400640 1 -- 172.21.15.42:0/3939567652 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc032440 con 0x7f86f00cc220 2024-08-17T02:30:50.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86ef400640 1 -- 172.21.15.42:0/3939567652 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc032800 con 0x7f86f00cc220 2024-08-17T02:30:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 -- 172.21.15.42:0/3939567652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc220 msgr2=0x7f86f00c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 --2- 172.21.15.42:0/3939567652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc220 0x7f86f00c90a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f86f006f3b0 tx=0x7f86dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 -- 172.21.15.42:0/3939567652 shutdown_connections 2024-08-17T02:30:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 --2- 172.21.15.42:0/3939567652 >> v2:172.21.15.62:3300/0 conn(0x7f86f00cc630 0x7f86f00c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 --2- 172.21.15.42:0/3939567652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc220 0x7f86f00c90a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 -- 172.21.15.42:0/3939567652 >> 172.21.15.42:0/3939567652 conn(0x7f86f00ce590 msgr2=0x7f86f00ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 -- 172.21.15.42:0/3939567652 shutdown_connections 2024-08-17T02:30:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.422+0000 7f86f7a00640 1 -- 172.21.15.42:0/3939567652 wait complete. 2024-08-17T02:30:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.424+0000 7f86f7a00640 1 Processor -- start 2024-08-17T02:30:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.424+0000 7f86f7a00640 1 -- start start 2024-08-17T02:30:50.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f7a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f00b0040 0x7f86f014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f7a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f00cc220 0x7f86f0168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 0x7f86f01548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01694d0 con 0x7f86f00cc630 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f7a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0154e30 con 0x7f86f00b0040 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f7a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0169f70 con 0x7f86f00cc220 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 0x7f86f01548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 0x7f86f01548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48098/0 (socket says 172.21.15.42:48098) 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 -- 172.21.15.42:0/1427025872 learned_addr learned my addr 172.21.15.42:0/1427025872 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5000640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f00b0040 0x7f86f014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86efe00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f00cc220 0x7f86f0168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 -- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f00cc220 msgr2=0x7f86f0168f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f00cc220 0x7f86f0168f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 -- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f00b0040 msgr2=0x7f86f014c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f00b0040 0x7f86f014c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.425+0000 7f86f5a00640 1 -- 172.21.15.42:0/1427025872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009450 con 0x7f86f00cc630 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.426+0000 7f86f5a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 0x7f86f01548f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009fd0 tx=0x7f86e8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.426+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800ee30 con 0x7f86f00cc630 2024-08-17T02:30:50.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.426+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8014420 con 0x7f86f00cc630 2024-08-17T02:30:50.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.426+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f01696d0 con 0x7f86f00cc630 2024-08-17T02:30:50.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.426+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80147e0 con 0x7f86f00cc630 2024-08-17T02:30:50.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.426+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f0169c90 con 0x7f86f00cc630 2024-08-17T02:30:50.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.428+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f0063fb0 con 0x7f86f00cc630 2024-08-17T02:30:50.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.429+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86e8014b50 con 0x7f86f00cc630 2024-08-17T02:30:50.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.430+0000 7f86e3e00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f86d0065180 0x7f86d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.430+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f86e80827b0 con 0x7f86f00cc630 2024-08-17T02:30:50.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.430+0000 7f86f5000640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f86d0065180 0x7f86d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.431+0000 7f86f5000640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f86d0065180 0x7f86d0067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86f0157110 tx=0x7f86e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.434+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f86e8050ba0 con 0x7f86f00cc630 2024-08-17T02:30:50.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.620+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f00af9a0 con 0x7f86f00cc630 2024-08-17T02:30:50.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.621+0000 7f86e3e00640 1 -- 172.21.15.42:0/1427025872 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12345 (secure 0 0 0) 0x7f86e80541c0 con 0x7f86f00cc630 2024-08-17T02:30:50.622 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:50.622 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":43,"fsid":"f1ed9b5c-6944-4c6d-99b1-a0cfa22f16b0","created":"2024-08-17T02:27:06.608582+0000","modified":"2024-08-17T02:30:45.724771+0000","last_up_change":"2024-08-17T02:27:17.915482+0000","last_in_change":"2024-08-17T02:27:09.476205+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:19.238087+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aaf84ea9-d493-4f52-aa1c-fd097035a165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":36872},{"type":"v1","addr":"172.21.15.42:6801","nonce":36872}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":36872},{"type":"v1","addr":"172.21.15.42:6803","nonce":36872}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":36872},{"type":"v1","addr":"172.21.15.42:6807","nonce":36872}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":36872},{"type":"v1","addr":"172.21.15.42:6805","nonce":36872}]},"public_addr":"172.21.15.42:6801/36872","cluster_addr":"172.21.15.42:6803/36872","heartbeat_back_addr":"172.21.15.42:6807/36872","heartbeat_front_addr":"172.21.15.42:6805/36872","state":["exists","up"]},{"osd":1,"uuid":"0e3c516d-4947-4360-a33d-38019a85176b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":36874},{"type":"v1","addr":"172.21.15.42:6825","nonce":36874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":36874},{"type":"v1","addr":"172.21.15.42:6827","nonce":36874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":36874},{"type":"v1","addr":"172.21.15.42:6831","nonce":36874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":36874},{"type":"v1","addr":"172.21.15.42:6829","nonce":36874}]},"public_addr":"172.21.15.42:6825/36874","cluster_addr":"172.21.15.42:6827/36874","heartbeat_back_addr":"172.21.15.42:6831/36874","heartbeat_front_addr":"172.21.15.42:6829/36874","state":["exists","up"]},{"osd":2,"uuid":"9b26ddac-f10a-4ec1-81e2-94c37068d7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":36875},{"type":"v1","addr":"172.21.15.42:6809","nonce":36875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":36875},{"type":"v1","addr":"172.21.15.42:6811","nonce":36875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":36875},{"type":"v1","addr":"172.21.15.42:6815","nonce":36875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":36875},{"type":"v1","addr":"172.21.15.42:6813","nonce":36875}]},"public_addr":"172.21.15.42:6809/36875","cluster_addr":"172.21.15.42:6811/36875","heartbeat_back_addr":"172.21.15.42:6815/36875","heartbeat_front_addr":"172.21.15.42:6813/36875","state":["exists","up"]},{"osd":3,"uuid":"2e0c1b8f-106c-4787-bc7f-37b1159ecb11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":36876},{"type":"v1","addr":"172.21.15.42:6817","nonce":36876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":36876},{"type":"v1","addr":"172.21.15.42:6819","nonce":36876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":36876},{"type":"v1","addr":"172.21.15.42:6823","nonce":36876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":36876},{"type":"v1","addr":"172.21.15.42:6821","nonce":36876}]},"public_addr":"172.21.15.42:6817/36876","cluster_addr":"172.21.15.42:6819/36876","heartbeat_back_addr":"172.21.15.42:6823/36876","heartbeat_front_addr":"172.21.15.42:6821/36876","state":["exists","up"]},{"osd":4,"uuid":"309ca7ca-583c-40f7-aa3b-6e19b75f1753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37389},{"type":"v1","addr":"172.21.15.62:6801","nonce":37389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37389},{"type":"v1","addr":"172.21.15.62:6803","nonce":37389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37389},{"type":"v1","addr":"172.21.15.62:6807","nonce":37389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37389},{"type":"v1","addr":"172.21.15.62:6805","nonce":37389}]},"public_addr":"172.21.15.62:6801/37389","cluster_addr":"172.21.15.62:6803/37389","heartbeat_back_addr":"172.21.15.62:6807/37389","heartbeat_front_addr":"172.21.15.62:6805/37389","state":["exists","up"]},{"osd":5,"uuid":"47e39f90-3172-4ff7-b9a0-2964183c02fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":37390},{"type":"v1","addr":"172.21.15.62:6809","nonce":37390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":37390},{"type":"v1","addr":"172.21.15.62:6811","nonce":37390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":37390},{"type":"v1","addr":"172.21.15.62:6815","nonce":37390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":37390},{"type":"v1","addr":"172.21.15.62:6813","nonce":37390}]},"public_addr":"172.21.15.62:6809/37390","cluster_addr":"172.21.15.62:6811/37390","heartbeat_back_addr":"172.21.15.62:6815/37390","heartbeat_front_addr":"172.21.15.62:6813/37390","state":["exists","up"]},{"osd":6,"uuid":"a4e2ad3a-18db-4267-974b-47ea6a5b67fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37406},{"type":"v1","addr":"172.21.15.62:6825","nonce":37406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37406},{"type":"v1","addr":"172.21.15.62:6827","nonce":37406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37406},{"type":"v1","addr":"172.21.15.62:6831","nonce":37406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37406},{"type":"v1","addr":"172.21.15.62:6829","nonce":37406}]},"public_addr":"172.21.15.62:6825/37406","cluster_addr":"172.21.15.62:6827/37406","heartbeat_back_addr":"172.21.15.62:6831/37406","heartbeat_front_addr":"172.21.15.62:6829/37406","state":["exists","up"]},{"osd":7,"uuid":"4c1c18a3-982a-4d69-9922-912a450abf79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37391},{"type":"v1","addr":"172.21.15.62:6817","nonce":37391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":37391},{"type":"v1","addr":"172.21.15.62:6819","nonce":37391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":37391},{"type":"v1","addr":"172.21.15.62:6823","nonce":37391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37391},{"type":"v1","addr":"172.21.15.62:6821","nonce":37391}]},"public_addr":"172.21.15.62:6817/37391","cluster_addr":"172.21.15.62:6819/37391","heartbeat_back_addr":"172.21.15.62:6823/37391","heartbeat_front_addr":"172.21.15.62:6821/37391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.822075+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.864659+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.860471+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.838893+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.796475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.806321+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.865622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:14.811145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6835/4011881108":"2024-08-18T02:30:42.540409+0000","172.21.15.62:6833/4011881108":"2024-08-18T02:30:42.540409+0000","172.21.15.42:6836/3869657839":"2024-08-18T02:30:35.671511+0000","172.21.15.42:6834/3869657839":"2024-08-18T02:30:35.671511+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:50.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f86d0065180 msgr2=0x7f86d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f86d0065180 0x7f86d0067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86f0157110 tx=0x7f86e4009040 comp rx=0 tx=0).stop 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 msgr2=0x7f86f01548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 0x7f86f01548f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009fd0 tx=0x7f86e8009900 comp rx=0 tx=0).stop 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 shutdown_connections 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f86d0065180 0x7f86d0067630 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f86f00cc630 0x7f86f01548f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f86f00cc220 0x7f86f0168f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 --2- 172.21.15.42:0/1427025872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86f00b0040 0x7f86f014c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 >> 172.21.15.42:0/1427025872 conn(0x7f86f00ce590 msgr2=0x7f86f00c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 shutdown_connections 2024-08-17T02:30:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:50.623+0000 7f86f7a00640 1 -- 172.21.15.42:0/1427025872 wait complete. 2024-08-17T02:30:51.640 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:30:51.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:51.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.797+0000 7f6cf8e00640 1 Processor -- start 2024-08-17T02:30:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.797+0000 7f6cf8e00640 1 -- start start 2024-08-17T02:30:51.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf8e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6cf41589a0 0x7f6cf40acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf8e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6cf4159b40 0x7f6cf406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf8e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40cd450 con 0x7f6cf40aef70 2024-08-17T02:30:51.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf8e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf40af3f0 con 0x7f6cf41589a0 2024-08-17T02:30:51.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf8e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf40ad380 con 0x7f6cf4159b40 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf1e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6cf41589a0 0x7f6cf40acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf1e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6cf41589a0 0x7f6cf40acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56294/0 (socket says 172.21.15.42:56294) 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.798+0000 7f6cf1e00640 1 -- 172.21.15.42:0/2981580695 learned_addr learned my addr 172.21.15.42:0/2981580695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.799+0000 7f6cf2800640 1 --2- 172.21.15.42:0/2981580695 >> v2:172.21.15.62:3300/0 conn(0x7f6cf4159b40 0x7f6cf406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.799+0000 7f6cf1e00640 1 -- 172.21.15.42:0/2981580695 >> v2:172.21.15.62:3300/0 conn(0x7f6cf4159b40 msgr2=0x7f6cf406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.799+0000 7f6cf1e00640 1 --2- 172.21.15.42:0/2981580695 >> v2:172.21.15.62:3300/0 conn(0x7f6cf4159b40 0x7f6cf406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.799+0000 7f6cf1e00640 1 -- 172.21.15.42:0/2981580695 >> v1:172.21.15.62:6789/0 conn(0x7f6cf40aef70 legacy=0x7f6cf4158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.799+0000 7f6cf1e00640 1 -- 172.21.15.42:0/2981580695 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40ad660 con 0x7f6cf41589a0 2024-08-17T02:30:51.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.799+0000 7f6cf2800640 1 --2- 172.21.15.42:0/2981580695 >> v2:172.21.15.62:3300/0 conn(0x7f6cf4159b40 0x7f6cf406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:51.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.800+0000 7f6cf1e00640 1 --2- 172.21.15.42:0/2981580695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf41589a0 0x7f6cf40acda0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40cc8f0 tx=0x7f6ce40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f695d5bff3d7fa7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.800+0000 7f6cf0a00640 1 -- 172.21.15.42:0/2981580695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce402ae80 con 0x7f6cf41589a0 2024-08-17T02:30:51.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.800+0000 7f6cf0a00640 1 -- 172.21.15.42:0/2981580695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4032440 con 0x7f6cf41589a0 2024-08-17T02:30:51.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.800+0000 7f6cf0a00640 1 -- 172.21.15.42:0/2981580695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4032800 con 0x7f6cf41589a0 2024-08-17T02:30:51.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 -- 172.21.15.42:0/2981580695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf41589a0 msgr2=0x7f6cf40acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 --2- 172.21.15.42:0/2981580695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf41589a0 0x7f6cf40acda0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40cc8f0 tx=0x7f6ce40091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 -- 172.21.15.42:0/2981580695 shutdown_connections 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 --2- 172.21.15.42:0/2981580695 >> v2:172.21.15.62:3300/0 conn(0x7f6cf4159b40 0x7f6cf406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 --2- 172.21.15.42:0/2981580695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf41589a0 0x7f6cf40acda0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 -- 172.21.15.42:0/2981580695 >> 172.21.15.42:0/2981580695 conn(0x7f6cf406c760 msgr2=0x7f6cf406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 -- 172.21.15.42:0/2981580695 shutdown_connections 2024-08-17T02:30:51.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.801+0000 7f6cf8e00640 1 -- 172.21.15.42:0/2981580695 wait complete. 2024-08-17T02:30:51.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.802+0000 7f6cf8e00640 1 Processor -- start 2024-08-17T02:30:51.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.802+0000 7f6cf8e00640 1 -- start start 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf40aef70 0x7f6cf4147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf8e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cf41589a0 0x7f6cf40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf8e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf4159b40 0x7f6cf4144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf8e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40cb050 con 0x7f6cf40aef70 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf8e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4144c50 con 0x7f6cf4159b40 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf8e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4144ed0 con 0x7f6cf41589a0 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.803+0000 7f6cf1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf40aef70 0x7f6cf4147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf40aef70 0x7f6cf4147200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56300/0 (socket says 172.21.15.42:56300) 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 -- 172.21.15.42:0/3545760765 learned_addr learned my addr 172.21.15.42:0/3545760765 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf2800640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf4159b40 0x7f6cf4144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 -- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cf41589a0 msgr2=0x7f6cf40cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1400640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cf41589a0 0x7f6cf40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cf41589a0 0x7f6cf40cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 -- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf4159b40 msgr2=0x7f6cf4144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf4159b40 0x7f6cf4144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 -- 172.21.15.42:0/3545760765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4009450 con 0x7f6cf40aef70 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1400640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6cf41589a0 0x7f6cf40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf2800640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6cf4159b40 0x7f6cf4144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.804+0000 7f6cf1e00640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf40aef70 0x7f6cf4147200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009210 tx=0x7f6ce4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.805+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4031a60 con 0x7f6cf40aef70 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.805+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4031be0 con 0x7f6cf40aef70 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.805+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce403d420 con 0x7f6cf40aef70 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.805+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf41451b0 con 0x7f6cf40aef70 2024-08-17T02:30:51.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.805+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4145770 con 0x7f6cf40aef70 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.806+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6cf4063fb0 con 0x7f6cf40aef70 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.807+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ce4039040 con 0x7f6cf40aef70 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6ce9600640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cd4065150 0x7f6cd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ce40a1ec0 con 0x7f6cf40aef70 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6ce9600640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7f6cd406b040 0x7f6cd406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 --> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cd406db00 con 0x7f6cd406b040 2024-08-17T02:30:51.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6cf1400640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cd4065150 0x7f6cd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ce40a43c0 con 0x7f6cf40aef70 2024-08-17T02:30:51.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.808+0000 7f6cf2800640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7f6cd406b040 0x7f6cd406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.809+0000 7f6cf1400640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cd4065150 0x7f6cd4067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40b0f40 tx=0x7f6ce0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.809+0000 7f6cf2800640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7f6cd406b040 0x7f6cd406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.810+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== osd.0 v2:172.21.15.42:6800/36872 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6cd406db00 con 0x7f6cd406b040 2024-08-17T02:30:51.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.822+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 --> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6cf4157f30 con 0x7f6cd406b040 2024-08-17T02:30:51.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6ce9600640 1 -- 172.21.15.42:0/3545760765 <== osd.0 v2:172.21.15.42:6800/36872 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6cf4157f30 con 0x7f6cd406b040 2024-08-17T02:30:51.824 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:51.825 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:51.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7f6cd406b040 msgr2=0x7f6cd406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6800/36872,v1:172.21.15.42:6801/36872] conn(0x7f6cd406b040 0x7f6cd406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cd4065150 msgr2=0x7f6cd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6cd4065150 0x7f6cd4067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40b0f40 tx=0x7f6ce0009040 comp rx=0 tx=0).stop 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf40aef70 msgr2=0x7f6cf4147200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 --2- 172.21.15.42:0/3545760765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf40aef70 0x7f6cf4147200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009210 tx=0x7f6ce4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf2800640 1 -- 172.21.15.42:0/3545760765 reap_dead start 2024-08-17T02:30:51.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 shutdown_connections 2024-08-17T02:30:51.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.823+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 >> 172.21.15.42:0/3545760765 conn(0x7f6cf406c760 msgr2=0x7f6cf406abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:51.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.824+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 shutdown_connections 2024-08-17T02:30:51.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.824+0000 7f6cf8e00640 1 -- 172.21.15.42:0/3545760765 wait complete. 2024-08-17T02:30:51.839 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:30:51.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.990+0000 7fcb3ce00640 1 Processor -- start 2024-08-17T02:30:51.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.990+0000 7fcb3ce00640 1 -- start start 2024-08-17T02:30:51.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.991+0000 7fcb3ce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.991+0000 7fcb3ce00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb380c92b0 con 0x7fcb380acf10 2024-08-17T02:30:51.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.991+0000 7fcb3ce00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb380ad480 con 0x7fcb381590b0 2024-08-17T02:30:51.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.991+0000 7fcb3ce00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380b0980 con 0x7fcb380afca0 2024-08-17T02:30:51.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb35400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fcb380acf10 0x7fcb381589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43404/0 (socket says 172.21.15.42:43404) 2024-08-17T02:30:51.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb35400640 1 -- 172.21.15.42:0/3720588855 learned_addr learned my addr 172.21.15.42:0/3720588855 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:51.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb35e00640 1 --2- 172.21.15.42:0/3720588855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052664797 0 0) 0x7fcb380c92b0 con 0x7fcb380acf10 2024-08-17T02:30:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb1c0034e0 con 0x7fcb380acf10 2024-08-17T02:30:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912170116 0 0) 0x7fcb380ad480 con 0x7fcb381590b0 2024-08-17T02:30:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb380c92b0 con 0x7fcb381590b0 2024-08-17T02:30:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb35e00640 1 -- 172.21.15.42:0/3720588855 >> v1:172.21.15.62:6789/0 conn(0x7fcb381590b0 legacy=0x7fcb380c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb35e00640 1 -- 172.21.15.42:0/3720588855 >> v1:172.21.15.42:6789/0 conn(0x7fcb380acf10 legacy=0x7fcb381589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.992+0000 7fcb35e00640 1 -- 172.21.15.42:0/3720588855 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380ad760 con 0x7fcb380afca0 2024-08-17T02:30:51.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.994+0000 7fcb35e00640 1 --2- 172.21.15.42:0/3720588855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380b0070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009880 tx=0x7fcb280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702931cd80664932 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.994+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2802ae10 con 0x7fcb380afca0 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.994+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb28032440 con 0x7fcb380afca0 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.994+0000 7fcb34a00640 1 -- 172.21.15.42:0/3720588855 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb280327e0 con 0x7fcb380afca0 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 -- 172.21.15.42:0/3720588855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 msgr2=0x7fcb380b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/3720588855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380b0070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009880 tx=0x7fcb280090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 -- 172.21.15.42:0/3720588855 shutdown_connections 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/3720588855 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380b0070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 -- 172.21.15.42:0/3720588855 >> 172.21.15.42:0/3720588855 conn(0x7fcb38066e60 msgr2=0x7fcb38067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 -- 172.21.15.42:0/3720588855 shutdown_connections 2024-08-17T02:30:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.995+0000 7fcb3ce00640 1 -- 172.21.15.42:0/3720588855 wait complete. 2024-08-17T02:30:52.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.996+0000 7fcb3ce00640 1 Processor -- start 2024-08-17T02:30:52.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.996+0000 7fcb3ce00640 1 -- start start 2024-08-17T02:30:52.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.997+0000 7fcb3ce00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb380acf10 0x7fcb381418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.997+0000 7fcb3ce00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.997+0000 7fcb3ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 0x7fcb38148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.997+0000 7fcb3ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380c7b80 con 0x7fcb381590b0 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.997+0000 7fcb3ce00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380c0c00 con 0x7fcb380acf10 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.997+0000 7fcb3ce00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3816a2f0 con 0x7fcb380afca0 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 0x7fcb38148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 0x7fcb38148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56308/0 (socket says 172.21.15.42:56308) 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 -- 172.21.15.42:0/2584378319 learned_addr learned my addr 172.21.15.42:0/2584378319 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:52.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb35400640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb35e00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb380acf10 0x7fcb381418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 -- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 msgr2=0x7fcb380c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 -- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb380acf10 msgr2=0x7fcb381418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb380acf10 0x7fcb381418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb36800640 1 -- 172.21.15.42:0/2584378319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28009390 con 0x7fcb381590b0 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb35e00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb380acf10 0x7fcb381418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:52.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.998+0000 7fcb35400640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.999+0000 7fcb36800640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 0x7fcb38148080 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c7c0 tx=0x7fcb30002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.999+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30002070 con 0x7fcb381590b0 2024-08-17T02:30:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.999+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb300021d0 con 0x7fcb381590b0 2024-08-17T02:30:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.999+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb381488c0 con 0x7fcb381590b0 2024-08-17T02:30:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.999+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000a640 con 0x7fcb381590b0 2024-08-17T02:30:52.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:51.999+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3816a540 con 0x7fcb381590b0 2024-08-17T02:30:52.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.000+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb38148cc0 con 0x7fcb381590b0 2024-08-17T02:30:52.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.001+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb3000aa70 con 0x7fcb381590b0 2024-08-17T02:30:52.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.002+0000 7fcb2d600640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcb18065150 0x7fcb18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.002+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcb30082170 con 0x7fcb381590b0 2024-08-17T02:30:52.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.002+0000 7fcb35e00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcb18065150 0x7fcb18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.003+0000 7fcb35e00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcb18065150 0x7fcb18067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb28034000 tx=0x7fcb28032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.006+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb30050430 con 0x7fcb381590b0 2024-08-17T02:30:52.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.188+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb38063fb0 con 0x7fcb18065150 2024-08-17T02:30:52.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.188+0000 7fcb2d600640 1 -- 172.21.15.42:0/2584378319 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb38063fb0 con 0x7fcb18065150 2024-08-17T02:30:52.190 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:30:52.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcb18065150 msgr2=0x7fcb18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcb18065150 0x7fcb18067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb28034000 tx=0x7fcb28032000 comp rx=0 tx=0).stop 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 msgr2=0x7fcb38148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 0x7fcb38148080 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c7c0 tx=0x7fcb30002650 comp rx=0 tx=0).stop 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 shutdown_connections 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcb18065150 0x7fcb18067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb381590b0 0x7fcb38148080 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcb380afca0 0x7fcb380c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 --2- 172.21.15.42:0/2584378319 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb380acf10 0x7fcb381418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 >> 172.21.15.42:0/2584378319 conn(0x7fcb38066e60 msgr2=0x7fcb38069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 shutdown_connections 2024-08-17T02:30:52.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.191+0000 7fcb3ce00640 1 -- 172.21.15.42:0/2584378319 wait complete. 2024-08-17T02:30:52.208 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:30:52.208 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.363+0000 7fdfeac00640 1 Processor -- start 2024-08-17T02:30:52.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.363+0000 7fdfeac00640 1 -- start start 2024-08-17T02:30:52.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.364+0000 7fdfeac00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdfe4156a90 0x7fdfe40ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.364+0000 7fdfeac00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe40ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfeac00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe41582b0 con 0x7fdfe40adba0 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfeac00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe40c9f80 con 0x7fdfe4156a90 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfeac00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40ca110 con 0x7fdfe40aef00 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdfe4156a90 0x7fdfe40ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdfe4156a90 0x7fdfe40ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56324/0 (socket says 172.21.15.42:56324) 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 -- 172.21.15.42:0/4053812088 learned_addr learned my addr 172.21.15.42:0/4053812088 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfdb400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fdfe40adba0 0x7fdfe40ae7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43414/0 (socket says 172.21.15.42:43414) 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe8c00640 1 --2- 172.21.15.42:0/4053812088 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe40ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 -- 172.21.15.42:0/4053812088 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 msgr2=0x7fdfe40ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 --2- 172.21.15.42:0/4053812088 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe40ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 -- 172.21.15.42:0/4053812088 >> v1:172.21.15.42:6789/0 conn(0x7fdfe40adba0 legacy=0x7fdfe40ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.365+0000 7fdfe3e00640 1 -- 172.21.15.42:0/4053812088 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40adff0 con 0x7fdfe4156a90 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.366+0000 7fdfe3e00640 1 --2- 172.21.15.42:0/4053812088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe4156a90 0x7fdfe40ad660 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009910 tx=0x7fdfd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3f8a3c3a1d652a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfe3400640 1 -- 172.21.15.42:0/4053812088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd402add0 con 0x7fdfe4156a90 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfe3400640 1 -- 172.21.15.42:0/4053812088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4032440 con 0x7fdfe4156a90 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfe3400640 1 -- 172.21.15.42:0/4053812088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4032820 con 0x7fdfe4156a90 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 -- 172.21.15.42:0/4053812088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe4156a90 msgr2=0x7fdfe40ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 --2- 172.21.15.42:0/4053812088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe4156a90 0x7fdfe40ad660 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009910 tx=0x7fdfd40091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 -- 172.21.15.42:0/4053812088 shutdown_connections 2024-08-17T02:30:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 --2- 172.21.15.42:0/4053812088 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe40ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 --2- 172.21.15.42:0/4053812088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe4156a90 0x7fdfe40ad660 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 -- 172.21.15.42:0/4053812088 >> 172.21.15.42:0/4053812088 conn(0x7fdfe4066e60 msgr2=0x7fdfe4067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 -- 172.21.15.42:0/4053812088 shutdown_connections 2024-08-17T02:30:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.367+0000 7fdfeac00640 1 -- 172.21.15.42:0/4053812088 wait complete. 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.369+0000 7fdfeac00640 1 Processor -- start 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.369+0000 7fdfeac00640 1 -- start start 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfeac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe40adba0 0x7fdfe40a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfeac00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfeac00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfe4156a90 0x7fdfe4159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfeac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40ad090 con 0x7fdfe40adba0 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfeac00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40ac480 con 0x7fdfe4156a90 2024-08-17T02:30:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfeac00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe40ac760 con 0x7fdfe40aef00 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe40adba0 0x7fdfe40a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe40adba0 0x7fdfe40a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56332/0 (socket says 172.21.15.42:56332) 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 -- 172.21.15.42:0/3874267797 learned_addr learned my addr 172.21.15.42:0/3874267797 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfdb400640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe8c00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfe4156a90 0x7fdfe4159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 -- 172.21.15.42:0/3874267797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 msgr2=0x7fdfe41597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdfe40aef00 0x7fdfe41597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 -- 172.21.15.42:0/3874267797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfe4156a90 msgr2=0x7fdfe4159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdfe4156a90 0x7fdfe4159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.370+0000 7fdfe3e00640 1 -- 172.21.15.42:0/3874267797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4009450 con 0x7fdfe40adba0 2024-08-17T02:30:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.371+0000 7fdfe3e00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe40adba0 0x7fdfe40a9f80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4035040 tx=0x7fdfd4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.371+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4031bb0 con 0x7fdfe40adba0 2024-08-17T02:30:52.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.371+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4031d30 con 0x7fdfe40adba0 2024-08-17T02:30:52.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.371+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe40aca40 con 0x7fdfe40adba0 2024-08-17T02:30:52.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.371+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4031ea0 con 0x7fdfe40adba0 2024-08-17T02:30:52.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.371+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe40aa4c0 con 0x7fdfe40adba0 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.372+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfe4063fb0 con 0x7fdfe40adba0 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.373+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdfd4039040 con 0x7fdfe40adba0 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfdbe00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fdfc0065150 0x7fdfc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdfd40a2440 con 0x7fdfe40adba0 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfdb400640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fdfc0065150 0x7fdfc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfdbe00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7fdfc006b040 0x7fdfc006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 --> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfc006db00 con 0x7fdfc006b040 2024-08-17T02:30:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfd40a4a80 con 0x7fdfe40adba0 2024-08-17T02:30:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.374+0000 7fdfe8c00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7fdfc006b040 0x7fdfc006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.375+0000 7fdfdb400640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fdfc0065150 0x7fdfc0067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40ae960 tx=0x7fdfcc007ce0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.375+0000 7fdfe8c00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7fdfc006b040 0x7fdfc006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.376+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== osd.1 v2:172.21.15.42:6824/36874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdfc006db00 con 0x7fdfc006b040 2024-08-17T02:30:52.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 --> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdfe41573c0 con 0x7fdfc006b040 2024-08-17T02:30:52.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfdbe00640 1 -- 172.21.15.42:0/3874267797 <== osd.1 v2:172.21.15.42:6824/36874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdfe41573c0 con 0x7fdfc006b040 2024-08-17T02:30:52.390 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:52.391 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:52.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7fdfc006b040 msgr2=0x7fdfc006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6824/36874,v1:172.21.15.42:6825/36874] conn(0x7fdfc006b040 0x7fdfc006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fdfc0065150 msgr2=0x7fdfc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fdfc0065150 0x7fdfc0067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdfe40ae960 tx=0x7fdfcc007ce0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe40adba0 msgr2=0x7fdfe40a9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfeac00640 1 --2- 172.21.15.42:0/3874267797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdfe40adba0 0x7fdfe40a9f80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4035040 tx=0x7fdfd4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.389+0000 7fdfe8c00640 1 -- 172.21.15.42:0/3874267797 reap_dead start 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.390+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 shutdown_connections 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.390+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 >> 172.21.15.42:0/3874267797 conn(0x7fdfe4066e60 msgr2=0x7fdfe4069730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.390+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 shutdown_connections 2024-08-17T02:30:52.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.390+0000 7fdfeac00640 1 -- 172.21.15.42:0/3874267797 wait complete. 2024-08-17T02:30:52.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:30:52.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.555+0000 7f094da00640 1 Processor -- start 2024-08-17T02:30:52.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.556+0000 7f094da00640 1 -- start start 2024-08-17T02:30:52.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094da00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f09480abdf0 0x7f0948159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 0x7f09480acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094da00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480c92b0 con 0x7f09480ad1a0 2024-08-17T02:30:52.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094da00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09480ad640 con 0x7f09480abdf0 2024-08-17T02:30:52.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480c8ca0 con 0x7f09481599b0 2024-08-17T02:30:52.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094d000640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f09480ad1a0 0x7f094806d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43424/0 (socket says 172.21.15.42:43424) 2024-08-17T02:30:52.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f094d000640 1 -- 172.21.15.42:0/833945570 learned_addr learned my addr 172.21.15.42:0/833945570 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:52.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f0947e00640 1 --2- 172.21.15.42:0/833945570 >> v2:172.21.15.62:3300/0 conn(0x7f09480abdf0 0x7f0948159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.557+0000 7f093fe00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 0x7f09480acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861737302 0 0) 0x7f09480c92b0 con 0x7f09480ad1a0 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f092c0034e0 con 0x7f09480ad1a0 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3209252697 0 0) 0x7f092c0034e0 con 0x7f09480ad1a0 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 msgr2=0x7f09480acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 0x7f09480acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 >> v2:172.21.15.62:3300/0 conn(0x7f09480abdf0 msgr2=0x7f0948159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 --2- 172.21.15.42:0/833945570 >> v2:172.21.15.62:3300/0 conn(0x7f09480abdf0 0x7f0948159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948159ec0 con 0x7f09480ad1a0 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f09400017f0 con 0x7f09480ad1a0 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 >> v1:172.21.15.42:6789/0 conn(0x7f09480ad1a0 legacy=0x7f094806d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f092c003a50 0x7f092c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c004780 0x7f092c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 0x7f092c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480ad640 con 0x7f092c003a50 2024-08-17T02:30:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480c8ca0 con 0x7f092c004780 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092c00ba80 con 0x7f09481599b0 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947e00640 1 --2- 172.21.15.42:0/833945570 >> v2:172.21.15.62:3300/0 conn(0x7f09480abdf0 0x7f0948159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f0947e00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f092c003a50 0x7f092c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.558+0000 7f094d000640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 0x7f092c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.559+0000 7f093fe00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c004780 0x7f092c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.559+0000 7f0947e00640 1 -- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 msgr2=0x7f092c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.559+0000 7f0947e00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f09481599b0 0x7f092c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.559+0000 7f0947e00640 1 -- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c004780 msgr2=0x7f092c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.559+0000 7f0947e00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f092c004780 0x7f092c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.559+0000 7f0947e00640 1 -- 172.21.15.42:0/833945570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c0034e0 con 0x7f092c003a50 2024-08-17T02:30:52.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.560+0000 7f0947e00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f092c003a50 0x7f092c003e60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0938009d20 tx=0x7f09380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddded9baabd91521 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.560+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938031400 con 0x7f092c003a50 2024-08-17T02:30:52.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.560+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093802d050 con 0x7f092c003a50 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.560+0000 7f0947400640 1 -- 172.21.15.42:0/833945570 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938031790 con 0x7f092c003a50 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094da00640 1 -- 172.21.15.42:0/833945570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f092c003a50 msgr2=0x7f092c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094da00640 1 --2- 172.21.15.42:0/833945570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f092c003a50 0x7f092c003e60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0938009d20 tx=0x7f09380090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094d000640 1 -- 172.21.15.42:0/833945570 reap_dead start 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094da00640 1 -- 172.21.15.42:0/833945570 shutdown_connections 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094da00640 1 -- 172.21.15.42:0/833945570 >> 172.21.15.42:0/833945570 conn(0x7f0948066e60 msgr2=0x7f0948067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094da00640 1 -- 172.21.15.42:0/833945570 shutdown_connections 2024-08-17T02:30:52.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.561+0000 7f094da00640 1 -- 172.21.15.42:0/833945570 wait complete. 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.562+0000 7f094da00640 1 Processor -- start 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.562+0000 7f094da00640 1 -- start start 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094da00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f092c003a50 0x7f09481502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094da00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0948150800 0x7f0948163a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 0x7f094814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094814ad00 con 0x7f0948163f70 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094da00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094814b880 con 0x7f0948150800 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094da00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094814af50 con 0x7f092c003a50 2024-08-17T02:30:52.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 0x7f094814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 0x7f094814e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56356/0 (socket says 172.21.15.42:56356) 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.563+0000 7f094d000640 1 -- 172.21.15.42:0/767436172 learned_addr learned my addr 172.21.15.42:0/767436172 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f093fe00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0948150800 0x7f0948163a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f0947e00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f092c003a50 0x7f09481502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094d000640 1 -- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f092c003a50 msgr2=0x7f09481502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094d000640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f092c003a50 0x7f09481502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094d000640 1 -- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0948150800 msgr2=0x7f0948163a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094d000640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0948150800 0x7f0948163a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094d000640 1 -- 172.21.15.42:0/767436172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094814b230 con 0x7f0948163f70 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f093fe00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0948150800 0x7f0948163a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094d000640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 0x7f094814e570 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f094806cd10 tx=0x7f0940002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000a6b0 con 0x7f0948163f70 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000a830 con 0x7f0948163f70 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000abf0 con 0x7f0948163f70 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.564+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094814b510 con 0x7f0948163f70 2024-08-17T02:30:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.565+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094814eab0 con 0x7f0948163f70 2024-08-17T02:30:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.566+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094814ba10 con 0x7f0948163f70 2024-08-17T02:30:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.566+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f094001d460 con 0x7f0948163f70 2024-08-17T02:30:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.567+0000 7f093f400640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0924065150 0x7f0924067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.567+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f09400824e0 con 0x7f0948163f70 2024-08-17T02:30:52.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.567+0000 7f0947e00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0924065150 0x7f0924067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.568+0000 7f0947e00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0924065150 0x7f0924067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0938034000 tx=0x7f0938035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.571+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0940050840 con 0x7f0948163f70 2024-08-17T02:30:52.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.755+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0948070720 con 0x7f0924065150 2024-08-17T02:30:52.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.755+0000 7f093f400640 1 -- 172.21.15.42:0/767436172 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0948070720 con 0x7f0924065150 2024-08-17T02:30:52.757 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:30:52.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0924065150 msgr2=0x7f0924067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0924065150 0x7f0924067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0938034000 tx=0x7f0938035000 comp rx=0 tx=0).stop 2024-08-17T02:30:52.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 msgr2=0x7f094814e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 0x7f094814e570 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f094806cd10 tx=0x7f0940002140 comp rx=0 tx=0).stop 2024-08-17T02:30:52.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 shutdown_connections 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0924065150 0x7f0924067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0948163f70 0x7f094814e570 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0948150800 0x7f0948163a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 --2- 172.21.15.42:0/767436172 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f092c003a50 0x7f09481502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.757+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 >> 172.21.15.42:0/767436172 conn(0x7f0948066e60 msgr2=0x7f09480ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.758+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 shutdown_connections 2024-08-17T02:30:52.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.758+0000 7f094da00640 1 -- 172.21.15.42:0/767436172 wait complete. 2024-08-17T02:30:52.774 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:30:52.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:52.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.928+0000 7fcf5f600640 1 Processor -- start 2024-08-17T02:30:52.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.928+0000 7fcf5f600640 1 -- start start 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf5f600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcf580add70 0x7fcf580ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf5f600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf581582b0 con 0x7fcf580aed30 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf5f600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580ca110 con 0x7fcf58156a90 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf5f600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580c9f80 con 0x7fcf580add70 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf57e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcf580add70 0x7fcf580ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf5d600640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fcf580aed30 0x7fcf580ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43426/0 (socket says 172.21.15.42:43426) 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf57e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcf580add70 0x7fcf580ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56368/0 (socket says 172.21.15.42:56368) 2024-08-17T02:30:52.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.929+0000 7fcf5d600640 1 -- 172.21.15.42:0/2485147569 learned_addr learned my addr 172.21.15.42:0/2485147569 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:52.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.930+0000 7fcf57e00640 1 -- 172.21.15.42:0/2485147569 >> v1:172.21.15.62:6789/0 conn(0x7fcf58156a90 legacy=0x7fcf580ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.930+0000 7fcf57400640 1 -- 172.21.15.42:0/2485147569 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671986899 0 0) 0x7fcf580ca110 con 0x7fcf58156a90 2024-08-17T02:30:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.930+0000 7fcf57e00640 1 -- 172.21.15.42:0/2485147569 >> v1:172.21.15.42:6789/0 conn(0x7fcf580aed30 legacy=0x7fcf580ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.930+0000 7fcf57e00640 1 -- 172.21.15.42:0/2485147569 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580af4b0 con 0x7fcf580add70 2024-08-17T02:30:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.931+0000 7fcf57e00640 1 --2- 172.21.15.42:0/2485147569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580add70 0x7fcf580ae7f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009850 tx=0x7fcf440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3005d61cde69712 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.931+0000 7fcf57400640 1 -- 172.21.15.42:0/2485147569 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4402ac60 con 0x7fcf580add70 2024-08-17T02:30:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.931+0000 7fcf57400640 1 -- 172.21.15.42:0/2485147569 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4402adc0 con 0x7fcf580add70 2024-08-17T02:30:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.931+0000 7fcf57400640 1 -- 172.21.15.42:0/2485147569 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44032670 con 0x7fcf580add70 2024-08-17T02:30:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 -- 172.21.15.42:0/2485147569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580add70 msgr2=0x7fcf580ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 --2- 172.21.15.42:0/2485147569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580add70 0x7fcf580ae7f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009850 tx=0x7fcf440090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 -- 172.21.15.42:0/2485147569 shutdown_connections 2024-08-17T02:30:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 --2- 172.21.15.42:0/2485147569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580add70 0x7fcf580ae7f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 -- 172.21.15.42:0/2485147569 >> 172.21.15.42:0/2485147569 conn(0x7fcf58066e60 msgr2=0x7fcf58067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 -- 172.21.15.42:0/2485147569 shutdown_connections 2024-08-17T02:30:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.932+0000 7fcf5f600640 1 -- 172.21.15.42:0/2485147569 wait complete. 2024-08-17T02:30:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.933+0000 7fcf5f600640 1 Processor -- start 2024-08-17T02:30:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.933+0000 7fcf5f600640 1 -- start start 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.934+0000 7fcf5f600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580add70 0x7fcf58151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.934+0000 7fcf5f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580aed30 0x7fcf5814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.934+0000 7fcf5f600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf58156a90 0x7fcf5814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.934+0000 7fcf5f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581697d0 con 0x7fcf580aed30 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.934+0000 7fcf5f600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5814dd40 con 0x7fcf58156a90 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.934+0000 7fcf5f600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5814e020 con 0x7fcf580add70 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580aed30 0x7fcf5814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580aed30 0x7fcf5814d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56376/0 (socket says 172.21.15.42:56376) 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 -- 172.21.15.42:0/2143132975 learned_addr learned my addr 172.21.15.42:0/2143132975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf5d600640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf58156a90 0x7fcf5814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf5cc00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580add70 0x7fcf58151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 -- 172.21.15.42:0/2143132975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580add70 msgr2=0x7fcf58151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf580add70 0x7fcf58151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 -- 172.21.15.42:0/2143132975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf58156a90 msgr2=0x7fcf5814d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf58156a90 0x7fcf5814d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 -- 172.21.15.42:0/2143132975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44009390 con 0x7fcf580aed30 2024-08-17T02:30:52.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.935+0000 7fcf57e00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580aed30 0x7fcf5814d130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009850 tx=0x7fcf44032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.936+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf440317b0 con 0x7fcf580aed30 2024-08-17T02:30:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.936+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44031930 con 0x7fcf580aed30 2024-08-17T02:30:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.936+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf44031cf0 con 0x7fcf580aed30 2024-08-17T02:30:52.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.936+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5814e300 con 0x7fcf580aed30 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.936+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf581523c0 con 0x7fcf580aed30 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.937+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf58063fb0 con 0x7fcf580aed30 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.938+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf44043030 con 0x7fcf580aed30 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.938+0000 7fcf4be00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf38065150 0x7fcf38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcf44041070 con 0x7fcf580aed30 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf5cc00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf38065150 0x7fcf38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf4be00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7fcf3806b040 0x7fcf3806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 --> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf3806db00 con 0x7fcf3806b040 2024-08-17T02:30:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf440a4a60 con 0x7fcf580aed30 2024-08-17T02:30:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf5d600640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7fcf3806b040 0x7fcf3806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf5cc00640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf38065150 0x7fcf38067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c003730 tx=0x7fcf4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.939+0000 7fcf5d600640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7fcf3806b040 0x7fcf3806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.940+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== osd.2 v2:172.21.15.42:6808/36875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcf3806db00 con 0x7fcf3806b040 2024-08-17T02:30:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.953+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 --> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf58155ef0 con 0x7fcf3806b040 2024-08-17T02:30:52.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.953+0000 7fcf4be00640 1 -- 172.21.15.42:0/2143132975 <== osd.2 v2:172.21.15.42:6808/36875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcf58155ef0 con 0x7fcf3806b040 2024-08-17T02:30:52.955 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:52.955 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:52.955 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7fcf3806b040 msgr2=0x7fcf3806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6808/36875,v1:172.21.15.42:6809/36875] conn(0x7fcf3806b040 0x7fcf3806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf38065150 msgr2=0x7fcf38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf38065150 0x7fcf38067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c003730 tx=0x7fcf4c009040 comp rx=0 tx=0).stop 2024-08-17T02:30:52.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580aed30 msgr2=0x7fcf5814d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 --2- 172.21.15.42:0/2143132975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf580aed30 0x7fcf5814d130 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcf44009850 tx=0x7fcf44032000 comp rx=0 tx=0).stop 2024-08-17T02:30:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5d600640 1 -- 172.21.15.42:0/2143132975 reap_dead start 2024-08-17T02:30:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 shutdown_connections 2024-08-17T02:30:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 >> 172.21.15.42:0/2143132975 conn(0x7fcf58066e60 msgr2=0x7fcf58155750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 shutdown_connections 2024-08-17T02:30:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:52.954+0000 7fcf5f600640 1 -- 172.21.15.42:0/2143132975 wait complete. 2024-08-17T02:30:52.969 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:30:53.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.120+0000 7fb251800640 1 Processor -- start 2024-08-17T02:30:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.120+0000 7fb251800640 1 -- start start 2024-08-17T02:30:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.121+0000 7fb251800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb24c0afca0 0x7fb24c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.121+0000 7fb251800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.121+0000 7fb251800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c15a4e0 con 0x7fb24c1589a0 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.121+0000 7fb251800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0b0980 con 0x7fb24c0afca0 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.121+0000 7fb251800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c92b0 con 0x7fb24c0acf10 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24aa00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb24c0afca0 0x7fb24c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24b400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb24c1589a0 0x7fb24c06d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43434/0 (socket says 172.21.15.42:43434) 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24b400640 1 -- 172.21.15.42:0/3117270790 learned_addr learned my addr 172.21.15.42:0/3117270790 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24a000640 1 --2- 172.21.15.42:0/3117270790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24aa00640 1 -- 172.21.15.42:0/3117270790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 msgr2=0x7fb24c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:53.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24aa00640 1 --2- 172.21.15.42:0/3117270790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24aa00640 1 -- 172.21.15.42:0/3117270790 >> v1:172.21.15.42:6789/0 conn(0x7fb24c1589a0 legacy=0x7fb24c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb249600640 1 -- 172.21.15.42:0/3117270790 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208171927 0 0) 0x7fb244001490 con 0x7fb24c1589a0 2024-08-17T02:30:53.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.122+0000 7fb24aa00640 1 -- 172.21.15.42:0/3117270790 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0ad480 con 0x7fb24c0afca0 2024-08-17T02:30:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.123+0000 7fb24aa00640 1 --2- 172.21.15.42:0/3117270790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c0afca0 0x7fb24c0b0070 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009880 tx=0x7fb23c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204cf28c365c64e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.123+0000 7fb249600640 1 -- 172.21.15.42:0/3117270790 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c02ad70 con 0x7fb24c0afca0 2024-08-17T02:30:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb249600640 1 -- 172.21.15.42:0/3117270790 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c032440 con 0x7fb24c0afca0 2024-08-17T02:30:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb249600640 1 -- 172.21.15.42:0/3117270790 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0327e0 con 0x7fb24c0afca0 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 -- 172.21.15.42:0/3117270790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c0afca0 msgr2=0x7fb24c0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 --2- 172.21.15.42:0/3117270790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c0afca0 0x7fb24c0b0070 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009880 tx=0x7fb23c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 -- 172.21.15.42:0/3117270790 shutdown_connections 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 --2- 172.21.15.42:0/3117270790 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 --2- 172.21.15.42:0/3117270790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c0afca0 0x7fb24c0b0070 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 -- 172.21.15.42:0/3117270790 >> 172.21.15.42:0/3117270790 conn(0x7fb24c066e60 msgr2=0x7fb24c067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 -- 172.21.15.42:0/3117270790 shutdown_connections 2024-08-17T02:30:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.124+0000 7fb251800640 1 -- 172.21.15.42:0/3117270790 wait complete. 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.126+0000 7fb251800640 1 Processor -- start 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.126+0000 7fb251800640 1 -- start start 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb251800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb251800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24c0afca0 0x7fb24c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb251800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 0x7fb24c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb251800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1554a0 con 0x7fb24c1589a0 2024-08-17T02:30:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb251800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1581e0 con 0x7fb24c0afca0 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb251800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c156300 con 0x7fb24c0acf10 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 0x7fb24c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 0x7fb24c159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56396/0 (socket says 172.21.15.42:56396) 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 -- 172.21.15.42:0/720388892 learned_addr learned my addr 172.21.15.42:0/720388892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24a000640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24c0afca0 0x7fb24c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24aa00640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 -- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 msgr2=0x7fb24c147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 -- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24c0afca0 msgr2=0x7fb24c158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24c0afca0 0x7fb24c158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24b400640 1 -- 172.21.15.42:0/720388892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009390 con 0x7fb24c1589a0 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.127+0000 7fb24a000640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24c0afca0 0x7fb24c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.128+0000 7fb24b400640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 0x7fb24c159360 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb24400cc10 tx=0x7fb244001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.128+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400a5e0 con 0x7fb24c1589a0 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.128+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400a740 con 0x7fb24c1589a0 2024-08-17T02:30:53.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.128+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c147d40 con 0x7fb24c1589a0 2024-08-17T02:30:53.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.128+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ab40 con 0x7fb24c1589a0 2024-08-17T02:30:53.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.128+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c1551c0 con 0x7fb24c1589a0 2024-08-17T02:30:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.129+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c063fb0 con 0x7fb24c1589a0 2024-08-17T02:30:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.130+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb2440070f0 con 0x7fb24c1589a0 2024-08-17T02:30:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.131+0000 7fb242000640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb22c065150 0x7fb22c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.131+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb244081fe0 con 0x7fb24c1589a0 2024-08-17T02:30:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.131+0000 7fb24aa00640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb22c065150 0x7fb22c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.132+0000 7fb24aa00640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb22c065150 0x7fb22c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb23c034000 tx=0x7fb23c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.135+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb2440503c0 con 0x7fb24c1589a0 2024-08-17T02:30:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.319+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb24c15a4e0 con 0x7fb22c065150 2024-08-17T02:30:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.319+0000 7fb242000640 1 -- 172.21.15.42:0/720388892 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb24c15a4e0 con 0x7fb22c065150 2024-08-17T02:30:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:30:53.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb22c065150 msgr2=0x7fb22c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb22c065150 0x7fb22c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb23c034000 tx=0x7fb23c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 msgr2=0x7fb24c159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 0x7fb24c159360 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb24400cc10 tx=0x7fb244001970 comp rx=0 tx=0).stop 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 shutdown_connections 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb22c065150 0x7fb22c067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb24c1589a0 0x7fb24c159360 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24c0afca0 0x7fb24c158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 --2- 172.21.15.42:0/720388892 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb24c0acf10 0x7fb24c147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 >> 172.21.15.42:0/720388892 conn(0x7fb24c066e60 msgr2=0x7fb24c0caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 shutdown_connections 2024-08-17T02:30:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.322+0000 7fb251800640 1 -- 172.21.15.42:0/720388892 wait complete. 2024-08-17T02:30:53.337 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:30:53.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:53.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.490+0000 7f782b200640 1 Processor -- start 2024-08-17T02:30:53.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.491+0000 7f782b200640 1 -- start start 2024-08-17T02:30:53.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f782b200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f782c158b00 0x7f782c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f782b200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f782c0b1fa0 0x7f782c0ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f782b200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0b07f0 con 0x7f782c069d10 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f782b200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0b0ad0 con 0x7f782c158b00 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f782b200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0b0db0 con 0x7f782c0b1fa0 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f7829e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f782c158b00 0x7f782c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f7823e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f782c069d10 0x7f782c0b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43436/0 (socket says 172.21.15.42:43436) 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f7823e00640 1 -- 172.21.15.42:0/1498180916 learned_addr learned my addr 172.21.15.42:0/1498180916 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f7829e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f782c158b00 0x7f782c0697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56402/0 (socket says 172.21.15.42:56402) 2024-08-17T02:30:53.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.492+0000 7f782a800640 1 --2- 172.21.15.42:0/1498180916 >> v2:172.21.15.62:3300/0 conn(0x7f782c0b1fa0 0x7f782c0ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.493+0000 7f7829e00640 1 -- 172.21.15.42:0/1498180916 >> v2:172.21.15.62:3300/0 conn(0x7f782c0b1fa0 msgr2=0x7f782c0ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.493+0000 7f7829e00640 1 --2- 172.21.15.42:0/1498180916 >> v2:172.21.15.62:3300/0 conn(0x7f782c0b1fa0 0x7f782c0ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.493+0000 7f7829e00640 1 -- 172.21.15.42:0/1498180916 >> v1:172.21.15.42:6789/0 conn(0x7f782c069d10 legacy=0x7f782c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.493+0000 7f7829e00640 1 -- 172.21.15.42:0/1498180916 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0b1090 con 0x7f782c158b00 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.493+0000 7f7829e00640 1 --2- 172.21.15.42:0/1498180916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c158b00 0x7f782c0697d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f782c0a8970 tx=0x7f781c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef1fd6886a1c5d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f7829400640 1 -- 172.21.15.42:0/1498180916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c02adb0 con 0x7f782c158b00 2024-08-17T02:30:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f7829400640 1 -- 172.21.15.42:0/1498180916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c032440 con 0x7f782c158b00 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f7829400640 1 -- 172.21.15.42:0/1498180916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c032820 con 0x7f782c158b00 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f782b200640 1 -- 172.21.15.42:0/1498180916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c158b00 msgr2=0x7f782c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f782b200640 1 --2- 172.21.15.42:0/1498180916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c158b00 0x7f782c0697d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f782c0a8970 tx=0x7f781c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f782b200640 1 -- 172.21.15.42:0/1498180916 shutdown_connections 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f782b200640 1 --2- 172.21.15.42:0/1498180916 >> v2:172.21.15.62:3300/0 conn(0x7f782c0b1fa0 0x7f782c0ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f782b200640 1 --2- 172.21.15.42:0/1498180916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c158b00 0x7f782c0697d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.494+0000 7f782b200640 1 -- 172.21.15.42:0/1498180916 >> 172.21.15.42:0/1498180916 conn(0x7f782c066e60 msgr2=0x7f782c067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.495+0000 7f782b200640 1 -- 172.21.15.42:0/1498180916 shutdown_connections 2024-08-17T02:30:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.495+0000 7f782b200640 1 -- 172.21.15.42:0/1498180916 wait complete. 2024-08-17T02:30:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.496+0000 7f782b200640 1 Processor -- start 2024-08-17T02:30:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.496+0000 7f782b200640 1 -- start start 2024-08-17T02:30:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c069d10 0x7f782c096ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782b200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f782c0b1fa0 0x7f782c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782b200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f782c158b00 0x7f782c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c097730 con 0x7f782c069d10 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782b200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c16d060 con 0x7f782c158b00 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782b200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c097450 con 0x7f782c0b1fa0 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f7829e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c069d10 0x7f782c096ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f7829e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c069d10 0x7f782c096ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56418/0 (socket says 172.21.15.42:56418) 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f7829e00640 1 -- 172.21.15.42:0/492674348 learned_addr learned my addr 172.21.15.42:0/492674348 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f782a800640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f782c158b00 0x7f782c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.497+0000 7f7823e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f782c0b1fa0 0x7f782c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7829e00640 1 -- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f782c0b1fa0 msgr2=0x7f782c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7829e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f782c0b1fa0 0x7f782c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7829e00640 1 -- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f782c158b00 msgr2=0x7f782c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7829e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f782c158b00 0x7f782c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7829e00640 1 -- 172.21.15.42:0/492674348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009390 con 0x7f782c069d10 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7823e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f782c0b1fa0 0x7f782c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7829e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c069d10 0x7f782c096ae0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f781c009360 tx=0x7f781c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c031de0 con 0x7f782c069d10 2024-08-17T02:30:53.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c03d420 con 0x7f782c069d10 2024-08-17T02:30:53.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c03d7e0 con 0x7f782c069d10 2024-08-17T02:30:53.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c16ca10 con 0x7f782c069d10 2024-08-17T02:30:53.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.498+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c097020 con 0x7f782c069d10 2024-08-17T02:30:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.499+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f782c097210 con 0x7f782c069d10 2024-08-17T02:30:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.500+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f781c039040 con 0x7f782c069d10 2024-08-17T02:30:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f7821600640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7808065150 0x7f7808067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f781c0a22a0 con 0x7f782c069d10 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f7821600640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7f780806b040 0x7f780806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f7823e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7808065150 0x7f7808067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 --> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f780806db00 con 0x7f780806b040 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f781c0a4800 con 0x7f782c069d10 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.501+0000 7f782a800640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7f780806b040 0x7f780806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.502+0000 7f7823e00640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7808065150 0x7f7808067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f782c0cb430 tx=0x7f7814009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.502+0000 7f782a800640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7f780806b040 0x7f780806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.503+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== osd.3 v2:172.21.15.42:6816/36876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f780806db00 con 0x7f780806b040 2024-08-17T02:30:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 --> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f782c16c870 con 0x7f780806b040 2024-08-17T02:30:53.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f7821600640 1 -- 172.21.15.42:0/492674348 <== osd.3 v2:172.21.15.42:6816/36876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f782c16c870 con 0x7f780806b040 2024-08-17T02:30:53.517 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:53.518 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:53.518 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7f780806b040 msgr2=0x7f780806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6816/36876,v1:172.21.15.42:6817/36876] conn(0x7f780806b040 0x7f780806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7808065150 msgr2=0x7f7808067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f7808065150 0x7f7808067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f782c0cb430 tx=0x7f7814009040 comp rx=0 tx=0).stop 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c069d10 msgr2=0x7f782c096ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 --2- 172.21.15.42:0/492674348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f782c069d10 0x7f782c096ae0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f781c009360 tx=0x7f781c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782a800640 1 -- 172.21.15.42:0/492674348 reap_dead start 2024-08-17T02:30:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 shutdown_connections 2024-08-17T02:30:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.516+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 >> 172.21.15.42:0/492674348 conn(0x7f782c066e60 msgr2=0x7f782c0ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.517+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 shutdown_connections 2024-08-17T02:30:53.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.517+0000 7f782b200640 1 -- 172.21.15.42:0/492674348 wait complete. 2024-08-17T02:30:53.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:30:53.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.682+0000 7fa4e1400640 1 Processor -- start 2024-08-17T02:30:53.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.682+0000 7fa4e1400640 1 -- start start 2024-08-17T02:30:53.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.683+0000 7fa4e1400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa4dc0afca0 0x7fa4dc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.683+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.683+0000 7fa4e1400640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc15a4e0 con 0x7fa4dc1589a0 2024-08-17T02:30:53.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.683+0000 7fa4e1400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b0980 con 0x7fa4dc0afca0 2024-08-17T02:30:53.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.683+0000 7fa4e1400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c92b0 con 0x7fa4dc0acf10 2024-08-17T02:30:53.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa4dc0afca0 0x7fa4dc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa4dc0afca0 0x7fa4dc0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56430/0 (socket says 172.21.15.42:56430) 2024-08-17T02:30:53.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 -- 172.21.15.42:0/2685893767 learned_addr learned my addr 172.21.15.42:0/2685893767 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:53.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4d9e00640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 -- 172.21.15.42:0/2685893767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 msgr2=0x7fa4dc159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:53.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 -- 172.21.15.42:0/2685893767 >> v1:172.21.15.62:6789/0 conn(0x7fa4dc1589a0 legacy=0x7fa4dc06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4da800640 1 -- 172.21.15.42:0/2685893767 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0ad480 con 0x7fa4dc0afca0 2024-08-17T02:30:53.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.684+0000 7fa4d9e00640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:53.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.685+0000 7fa4da800640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0b0070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009940 tx=0x7fa4cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562afa93e6a789c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4d9400640 1 -- 172.21.15.42:0/2685893767 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc02ae40 con 0x7fa4dc0afca0 2024-08-17T02:30:53.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4d9400640 1 -- 172.21.15.42:0/2685893767 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc032440 con 0x7fa4dc0afca0 2024-08-17T02:30:53.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4d9400640 1 -- 172.21.15.42:0/2685893767 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc032820 con 0x7fa4dc0afca0 2024-08-17T02:30:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 -- 172.21.15.42:0/2685893767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc0afca0 msgr2=0x7fa4dc0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0b0070 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009940 tx=0x7fa4cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 -- 172.21.15.42:0/2685893767 shutdown_connections 2024-08-17T02:30:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2685893767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0b0070 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 -- 172.21.15.42:0/2685893767 >> 172.21.15.42:0/2685893767 conn(0x7fa4dc066e60 msgr2=0x7fa4dc067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 -- 172.21.15.42:0/2685893767 shutdown_connections 2024-08-17T02:30:53.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.686+0000 7fa4e1400640 1 -- 172.21.15.42:0/2685893767 wait complete. 2024-08-17T02:30:53.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.688+0000 7fa4e1400640 1 Processor -- start 2024-08-17T02:30:53.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.688+0000 7fa4e1400640 1 -- start start 2024-08-17T02:30:53.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 0x7fa4dc146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4e1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc169690 con 0x7fa4dc1589a0 2024-08-17T02:30:53.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4e1400640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc145270 con 0x7fa4dc0afca0 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4e1400640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc149570 con 0x7fa4dc0acf10 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4db200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 0x7fa4dc146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4db200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 0x7fa4dc146ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56436/0 (socket says 172.21.15.42:56436) 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4db200640 1 -- 172.21.15.42:0/2375076861 learned_addr learned my addr 172.21.15.42:0/2375076861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4da800640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.689+0000 7fa4d9e00640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4db200640 1 -- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 msgr2=0x7fa4dc148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4db200640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4db200640 1 -- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4dc0afca0 msgr2=0x7fa4dc0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4db200640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4db200640 1 -- 172.21.15.42:0/2375076861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009450 con 0x7fa4dc1589a0 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4db200640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 0x7fa4dc146ff0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c7f0 tx=0x7fa4d40015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400a640 con 0x7fa4dc1589a0 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d400a7c0 con 0x7fa4dc1589a0 2024-08-17T02:30:53.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400ab80 con 0x7fa4dc1589a0 2024-08-17T02:30:53.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc149850 con 0x7fa4dc1589a0 2024-08-17T02:30:53.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.690+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc0c7550 con 0x7fa4dc1589a0 2024-08-17T02:30:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.691+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc169800 con 0x7fa4dc1589a0 2024-08-17T02:30:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.692+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4d4003030 con 0x7fa4dc1589a0 2024-08-17T02:30:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.693+0000 7fa4d2000640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa4bc065150 0x7fa4bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.694+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa4d4082060 con 0x7fa4dc1589a0 2024-08-17T02:30:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.694+0000 7fa4da800640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa4bc065150 0x7fa4bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.694+0000 7fa4da800640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa4bc065150 0x7fa4bc067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc034000 tx=0x7fa4cc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.697+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4dc169800 con 0x7fa4dc1589a0 2024-08-17T02:30:53.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.879+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4dc15a4e0 con 0x7fa4bc065150 2024-08-17T02:30:53.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.879+0000 7fa4d2000640 1 -- 172.21.15.42:0/2375076861 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4dc15a4e0 con 0x7fa4bc065150 2024-08-17T02:30:53.881 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:30:53.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa4bc065150 msgr2=0x7fa4bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa4bc065150 0x7fa4bc067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc034000 tx=0x7fa4cc032000 comp rx=0 tx=0).stop 2024-08-17T02:30:53.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 msgr2=0x7fa4dc146ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 0x7fa4dc146ff0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c7f0 tx=0x7fa4d40015f0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 shutdown_connections 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fa4bc065150 0x7fa4bc067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4dc1589a0 0x7fa4dc146ff0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4dc0afca0 0x7fa4dc0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 --2- 172.21.15.42:0/2375076861 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa4dc0acf10 0x7fa4dc148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 >> 172.21.15.42:0/2375076861 conn(0x7fa4dc066e60 msgr2=0x7fa4dc158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 shutdown_connections 2024-08-17T02:30:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:53.882+0000 7fa4e1400640 1 -- 172.21.15.42:0/2375076861 wait complete. 2024-08-17T02:30:53.898 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:30:53.898 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.052+0000 7f6dc8a00640 1 Processor -- start 2024-08-17T02:30:54.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.052+0000 7f6dc8a00640 1 -- start start 2024-08-17T02:30:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.053+0000 7f6dc8a00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6dc4158bb0 0x7f6dc40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.053+0000 7f6dc8a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc40cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.053+0000 7f6dc8a00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc40cc9e0 con 0x7f6dc40cb600 2024-08-17T02:30:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.053+0000 7f6dc8a00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc40cbdd0 con 0x7f6dc4158bb0 2024-08-17T02:30:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.053+0000 7f6dc8a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40cc0b0 con 0x7f6dc4158f80 2024-08-17T02:30:54.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1400640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc40cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc2800640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6dc40cb600 0x7f6dc40b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.42:42496/0 (socket says 172.21.15.42:42496) 2024-08-17T02:30:54.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc2800640 1 -- 172.21.15.42:0/3284434719 learned_addr learned my addr 172.21.15.42:0/3284434719 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:54.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1e00640 1 --2- 172.21.15.42:0/3284434719 >> v2:172.21.15.62:3300/0 conn(0x7f6dc4158bb0 0x7f6dc40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc0a00640 1 -- 172.21.15.42:0/3284434719 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973966797 0 0) 0x7f6dc40cc9e0 con 0x7f6dc40cb600 2024-08-17T02:30:54.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc0a00640 1 -- 172.21.15.42:0/3284434719 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da80034e0 con 0x7f6dc40cb600 2024-08-17T02:30:54.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1e00640 1 -- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 msgr2=0x7f6dc40cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1e00640 1 --2- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc40cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1e00640 1 -- 172.21.15.42:0/3284434719 >> v1:172.21.15.62:6789/0 conn(0x7f6dc40cb600 legacy=0x7f6dc40b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1e00640 1 -- 172.21.15.42:0/3284434719 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc40cc390 con 0x7f6dc4158bb0 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.054+0000 7f6dc1400640 1 --2- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc40cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.055+0000 7f6dc1e00640 1 --2- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 0x7f6dc40cce70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009850 tx=0x7f6db40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742a764d4ed19a4e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc0a00640 1 -- 172.21.15.42:0/3284434719 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db402ad00 con 0x7f6dc4158bb0 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc0a00640 1 -- 172.21.15.42:0/3284434719 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db402ae60 con 0x7f6dc4158bb0 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc0a00640 1 -- 172.21.15.42:0/3284434719 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4032670 con 0x7f6dc4158bb0 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 -- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 msgr2=0x7f6dc40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 --2- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 0x7f6dc40cce70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009850 tx=0x7f6db40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 -- 172.21.15.42:0/3284434719 shutdown_connections 2024-08-17T02:30:54.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 --2- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc40cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 --2- 172.21.15.42:0/3284434719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 0x7f6dc40cce70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 -- 172.21.15.42:0/3284434719 >> 172.21.15.42:0/3284434719 conn(0x7f6dc406e590 msgr2=0x7f6dc406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 -- 172.21.15.42:0/3284434719 shutdown_connections 2024-08-17T02:30:54.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.056+0000 7f6dc8a00640 1 -- 172.21.15.42:0/3284434719 wait complete. 2024-08-17T02:30:54.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.058+0000 7f6dc8a00640 1 Processor -- start 2024-08-17T02:30:54.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.058+0000 7f6dc8a00640 1 -- start start 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc40cb600 0x7f6dc4068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc8a00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 0x7f6dc40c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc8a00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc8a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c99b0 con 0x7f6dc40cb600 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc8a00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c9c90 con 0x7f6dc4158bb0 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc8a00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c9f70 con 0x7f6dc4158f80 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc40cb600 0x7f6dc4068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc40cb600 0x7f6dc4068840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56450/0 (socket says 172.21.15.42:56450) 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc1e00640 1 -- 172.21.15.42:0/1122049898 learned_addr learned my addr 172.21.15.42:0/1122049898 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc1400640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 0x7f6dc40c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.059+0000 7f6dc2800640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc1e00640 1 -- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 msgr2=0x7f6dc4155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc1e00640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6dc4158f80 0x7f6dc4155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc1e00640 1 -- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 msgr2=0x7f6dc40c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc1e00640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6dc4158bb0 0x7f6dc40c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc1e00640 1 -- 172.21.15.42:0/1122049898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009390 con 0x7f6dc40cb600 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc1e00640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc40cb600 0x7f6dc4068840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009850 tx=0x7f6db4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db403b6e0 con 0x7f6dc40cb600 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db403b860 con 0x7f6dc40cb600 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db4009390 con 0x7f6dc40cb600 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db403bc20 con 0x7f6dc40cb600 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.060+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40a6960 con 0x7f6dc40cb600 2024-08-17T02:30:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.061+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dc4063fb0 con 0x7f6dc40cb600 2024-08-17T02:30:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.062+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6db4043030 con 0x7f6dc40cb600 2024-08-17T02:30:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.063+0000 7f6db9600640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6da4065150 0x7f6da4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.063+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6db4041070 con 0x7f6dc40cb600 2024-08-17T02:30:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.063+0000 7f6dc1400640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6da4065150 0x7f6da4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.063+0000 7f6db9600640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7f6da406b040 0x7f6da406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.063+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 --> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6da406db00 con 0x7f6da406b040 2024-08-17T02:30:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.063+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6db40a4a20 con 0x7f6dc40cb600 2024-08-17T02:30:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.064+0000 7f6dc2800640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7f6da406b040 0x7f6da406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.064+0000 7f6dc1400640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6da4065150 0x7f6da4067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40b53e0 tx=0x7f6db00090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.064+0000 7f6dc2800640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7f6da406b040 0x7f6da406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.065+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== osd.4 v2:172.21.15.62:6800/37389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6da406db00 con 0x7f6da406b040 2024-08-17T02:30:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.078+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 --> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6dc4067690 con 0x7f6da406b040 2024-08-17T02:30:54.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6db9600640 1 -- 172.21.15.42:0/1122049898 <== osd.4 v2:172.21.15.62:6800/37389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6dc4067690 con 0x7f6da406b040 2024-08-17T02:30:54.080 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:54.080 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:54.080 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:54.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7f6da406b040 msgr2=0x7f6da406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.62:6800/37389,v1:172.21.15.62:6801/37389] conn(0x7f6da406b040 0x7f6da406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6da4065150 msgr2=0x7f6da4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f6da4065150 0x7f6da4067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40b53e0 tx=0x7f6db00090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc40cb600 msgr2=0x7f6dc4068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 --2- 172.21.15.42:0/1122049898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc40cb600 0x7f6dc4068840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009850 tx=0x7f6db4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc2800640 1 -- 172.21.15.42:0/1122049898 reap_dead start 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 shutdown_connections 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 >> 172.21.15.42:0/1122049898 conn(0x7f6dc406e590 msgr2=0x7f6dc40b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 shutdown_connections 2024-08-17T02:30:54.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.079+0000 7f6dc8a00640 1 -- 172.21.15.42:0/1122049898 wait complete. 2024-08-17T02:30:54.095 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:30:54.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.245+0000 7f9827e00640 1 Processor -- start 2024-08-17T02:30:54.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.245+0000 7f9827e00640 1 -- start start 2024-08-17T02:30:54.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.246+0000 7f9827e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9828158dd0 0x7f982806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.246+0000 7f9827e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982806ef10 con 0x7f982806ead0 2024-08-17T02:30:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.246+0000 7f9827e00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280cbc50 con 0x7f9828158a00 2024-08-17T02:30:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.246+0000 7f9827e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9828159200 con 0x7f9828158dd0 2024-08-17T02:30:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.246+0000 7f9827400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f982806ead0 0x7f98280b3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43442/0 (socket says 172.21.15.42:43442) 2024-08-17T02:30:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.246+0000 7f9827400640 1 -- 172.21.15.42:0/1290850988 learned_addr learned my addr 172.21.15.42:0/1290850988 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9826000640 1 --2- 172.21.15.42:0/1290850988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9828158dd0 0x7f982806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651703444 0 0) 0x7f982806ef10 con 0x7f982806ead0 2024-08-17T02:30:54.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f980c0034e0 con 0x7f982806ead0 2024-08-17T02:30:54.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218830111 0 0) 0x7f98280cbc50 con 0x7f9828158a00 2024-08-17T02:30:54.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f982806ef10 con 0x7f9828158a00 2024-08-17T02:30:54.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9826000640 1 -- 172.21.15.42:0/1290850988 >> v1:172.21.15.62:6789/0 conn(0x7f9828158a00 legacy=0x7f98280cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9826000640 1 -- 172.21.15.42:0/1290850988 >> v1:172.21.15.42:6789/0 conn(0x7f982806ead0 legacy=0x7f98280b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.247+0000 7f9826000640 1 -- 172.21.15.42:0/1290850988 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280cbf30 con 0x7f9828158dd0 2024-08-17T02:30:54.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.248+0000 7f9826000640 1 --2- 172.21.15.42:0/1290850988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9828158dd0 0x7f982806e590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9814009880 tx=0x7f98140090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60279a280f56b270 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.248+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981402ae10 con 0x7f9828158dd0 2024-08-17T02:30:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814032440 con 0x7f9828158dd0 2024-08-17T02:30:54.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9825600640 1 -- 172.21.15.42:0/1290850988 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140327e0 con 0x7f9828158dd0 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 -- 172.21.15.42:0/1290850988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9828158dd0 msgr2=0x7f982806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 --2- 172.21.15.42:0/1290850988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9828158dd0 0x7f982806e590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9814009880 tx=0x7f98140090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 -- 172.21.15.42:0/1290850988 shutdown_connections 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 --2- 172.21.15.42:0/1290850988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9828158dd0 0x7f982806e590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 -- 172.21.15.42:0/1290850988 >> 172.21.15.42:0/1290850988 conn(0x7f98280cfb80 msgr2=0x7f98280cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 -- 172.21.15.42:0/1290850988 shutdown_connections 2024-08-17T02:30:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.249+0000 7f9827e00640 1 -- 172.21.15.42:0/1290850988 wait complete. 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 Processor -- start 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 -- start start 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982806ead0 0x7f98280c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9828158a00 0x7f982815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 0x7f98281698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280c98d0 con 0x7f9828158dd0 2024-08-17T02:30:54.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280a7190 con 0x7f9828158a00 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.251+0000 7f9827e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280c6890 con 0x7f982806ead0 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 0x7f98281698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 0x7f98281698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56456/0 (socket says 172.21.15.42:56456) 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 -- 172.21.15.42:0/3135018670 learned_addr learned my addr 172.21.15.42:0/3135018670 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9826000640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9828158a00 0x7f982815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9826a00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982806ead0 0x7f98280c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 -- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982806ead0 msgr2=0x7f98280c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982806ead0 0x7f98280c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 -- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9828158a00 msgr2=0x7f982815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9828158a00 0x7f982815d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9827400640 1 -- 172.21.15.42:0/3135018670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814009390 con 0x7f9828158dd0 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.252+0000 7f9826a00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982806ead0 0x7f98280c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.253+0000 7f9827400640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 0x7f98281698d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f982000cc90 tx=0x7f9820001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.253+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000a850 con 0x7f9828158dd0 2024-08-17T02:30:54.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.253+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000a9d0 con 0x7f9828158dd0 2024-08-17T02:30:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.253+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9828158480 con 0x7f9828158dd0 2024-08-17T02:30:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.253+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000ad90 con 0x7f9828158dd0 2024-08-17T02:30:54.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.253+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98280c8b90 con 0x7f9828158dd0 2024-08-17T02:30:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.254+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98280c69d0 con 0x7f9828158dd0 2024-08-17T02:30:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.255+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9820007300 con 0x7f9828158dd0 2024-08-17T02:30:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.256+0000 7f981e000640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9808065150 0x7f9808067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.256+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9820082120 con 0x7f9828158dd0 2024-08-17T02:30:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.256+0000 7f9826a00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9808065150 0x7f9808067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.257+0000 7f9826a00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9808065150 0x7f9808067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9818003900 tx=0x7f9818009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.260+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f98280c69d0 con 0x7f9828158dd0 2024-08-17T02:30:54.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.443+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9828158480 con 0x7f9808065150 2024-08-17T02:30:54.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.443+0000 7f981e000640 1 -- 172.21.15.42:0/3135018670 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9828158480 con 0x7f9808065150 2024-08-17T02:30:54.445 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:30:54.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9808065150 msgr2=0x7f9808067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9808065150 0x7f9808067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9818003900 tx=0x7f9818009040 comp rx=0 tx=0).stop 2024-08-17T02:30:54.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 msgr2=0x7f98281698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 0x7f98281698d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f982000cc90 tx=0x7f9820001ae0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 shutdown_connections 2024-08-17T02:30:54.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9808065150 0x7f9808067600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9828158dd0 0x7f98281698d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9828158a00 0x7f982815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 --2- 172.21.15.42:0/3135018670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f982806ead0 0x7f98280c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 >> 172.21.15.42:0/3135018670 conn(0x7f98280cfb80 msgr2=0x7f98280cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.445+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 shutdown_connections 2024-08-17T02:30:54.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.446+0000 7f9827e00640 1 -- 172.21.15.42:0/3135018670 wait complete. 2024-08-17T02:30:54.462 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:30:54.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:54.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.616+0000 7fcfb5200640 1 Processor -- start 2024-08-17T02:30:54.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.616+0000 7fcfb5200640 1 -- start start 2024-08-17T02:30:54.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.617+0000 7fcfb5200640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcfb0142600 0x7fcfb0069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.617+0000 7fcfb5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb006a260 0x7fcfb00a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.617+0000 7fcfb5200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcfb01429d0 0x7fcfb00a9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.617+0000 7fcfb5200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb006b360 con 0x7fcfb01429d0 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.617+0000 7fcfb5200640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb006a750 con 0x7fcfb0142600 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.617+0000 7fcfb5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb006aa30 con 0x7fcfb006a260 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcfb01429d0 0x7fcfb00a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcfb01429d0 0x7fcfb00a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56462/0 (socket says 172.21.15.42:56462) 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 -- 172.21.15.42:0/266137510 learned_addr learned my addr 172.21.15.42:0/266137510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:54.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfade00640 1 --2- 172.21.15.42:0/266137510 >> v2:172.21.15.62:3300/0 conn(0x7fcfb0142600 0x7fcfb0069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfad400640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb006a260 0x7fcfb00a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 -- 172.21.15.42:0/266137510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb006a260 msgr2=0x7fcfb00a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb006a260 0x7fcfb00a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 -- 172.21.15.42:0/266137510 >> v2:172.21.15.62:3300/0 conn(0x7fcfb0142600 msgr2=0x7fcfb0069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 --2- 172.21.15.42:0/266137510 >> v2:172.21.15.62:3300/0 conn(0x7fcfb0142600 0x7fcfb0069d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfae800640 1 -- 172.21.15.42:0/266137510 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb006ad10 con 0x7fcfb01429d0 2024-08-17T02:30:54.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.618+0000 7fcfad400640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb006a260 0x7fcfb00a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.619+0000 7fcfae800640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb00a9730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006f310 tx=0x7fcfa8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769ff6bd25820d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.619+0000 7fcfaca00640 1 -- 172.21.15.42:0/266137510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8031400 con 0x7fcfb01429d0 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.619+0000 7fcfaca00640 1 -- 172.21.15.42:0/266137510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa802d050 con 0x7fcfb01429d0 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfaca00640 1 -- 172.21.15.42:0/266137510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80317d0 con 0x7fcfb01429d0 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 -- 172.21.15.42:0/266137510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 msgr2=0x7fcfb00a9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb00a9730 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfb006f310 tx=0x7fcfa8009840 comp rx=0 tx=0).stop 2024-08-17T02:30:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 -- 172.21.15.42:0/266137510 shutdown_connections 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb00a9730 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 --2- 172.21.15.42:0/266137510 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb006a260 0x7fcfb00a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 --2- 172.21.15.42:0/266137510 >> v2:172.21.15.62:3300/0 conn(0x7fcfb0142600 0x7fcfb0069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 -- 172.21.15.42:0/266137510 >> 172.21.15.42:0/266137510 conn(0x7fcfb0066e60 msgr2=0x7fcfb0067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 -- 172.21.15.42:0/266137510 shutdown_connections 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.620+0000 7fcfb5200640 1 -- 172.21.15.42:0/266137510 wait complete. 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.622+0000 7fcfb5200640 1 Processor -- start 2024-08-17T02:30:54.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.622+0000 7fcfb5200640 1 -- start start 2024-08-17T02:30:54.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfb5200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb006a260 0x7fcfb015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfb5200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb0142600 0x7fcfb0169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfb5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb013d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfb5200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0169740 con 0x7fcfb01429d0 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfb5200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb016a560 con 0x7fcfb006a260 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfb5200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0169950 con 0x7fcfb0142600 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb013d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb013d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56466/0 (socket says 172.21.15.42:56466) 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfae800640 1 -- 172.21.15.42:0/507082217 learned_addr learned my addr 172.21.15.42:0/507082217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfade00640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb006a260 0x7fcfb015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.623+0000 7fcfad400640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb0142600 0x7fcfb0169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfae800640 1 -- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb0142600 msgr2=0x7fcfb0169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfae800640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcfb0142600 0x7fcfb0169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfae800640 1 -- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb006a260 msgr2=0x7fcfb015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfae800640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfb006a260 0x7fcfb015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfae800640 1 -- 172.21.15.42:0/507082217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8009ae0 con 0x7fcfb01429d0 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfae800640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb013d210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009f50 tx=0x7fcfa8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8007170 con 0x7fcfb01429d0 2024-08-17T02:30:54.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8008e50 con 0x7fcfb01429d0 2024-08-17T02:30:54.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa803b640 con 0x7fcfb01429d0 2024-08-17T02:30:54.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb0169c30 con 0x7fcfb01429d0 2024-08-17T02:30:54.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.624+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb016a1f0 con 0x7fcfb01429d0 2024-08-17T02:30:54.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.625+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfb0063fb0 con 0x7fcfb01429d0 2024-08-17T02:30:54.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.626+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcfa8038050 con 0x7fcfb01429d0 2024-08-17T02:30:54.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.627+0000 7fcfa5600640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf90065150 0x7fcf90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.627+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcfa80a2dc0 con 0x7fcfb01429d0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.627+0000 7fcfa5600640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7fcf9006aed0 0x7fcf9006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.627+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 --> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf9006d990 con 0x7fcf9006aed0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.627+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa80a52c0 con 0x7fcfb01429d0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.627+0000 7fcfade00640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf90065150 0x7fcf90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.628+0000 7fcfad400640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7fcf9006aed0 0x7fcf9006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.628+0000 7fcfade00640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf90065150 0x7fcf90067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009d20 tx=0x7fcfa00090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.628+0000 7fcfad400640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7fcf9006aed0 0x7fcf9006d2e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.629+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== osd.5 v2:172.21.15.62:6808/37390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcf9006d990 con 0x7fcf9006aed0 2024-08-17T02:30:54.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.642+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 --> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcfb0158fd0 con 0x7fcf9006aed0 2024-08-17T02:30:54.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.642+0000 7fcfa5600640 1 -- 172.21.15.42:0/507082217 <== osd.5 v2:172.21.15.62:6808/37390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcfb0158fd0 con 0x7fcf9006aed0 2024-08-17T02:30:54.644 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:54.644 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:54.644 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:54.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7fcf9006aed0 msgr2=0x7fcf9006d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.62:6808/37390,v1:172.21.15.62:6809/37390] conn(0x7fcf9006aed0 0x7fcf9006d2e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf90065150 msgr2=0x7fcf90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fcf90065150 0x7fcf90067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009d20 tx=0x7fcfa00090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 msgr2=0x7fcfb013d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 --2- 172.21.15.42:0/507082217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb01429d0 0x7fcfb013d210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009f50 tx=0x7fcfa8036000 comp rx=0 tx=0).stop 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfae800640 1 -- 172.21.15.42:0/507082217 reap_dead start 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 shutdown_connections 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 >> 172.21.15.42:0/507082217 conn(0x7fcfb0066e60 msgr2=0x7fcfb006e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 shutdown_connections 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.643+0000 7fcfb5200640 1 -- 172.21.15.42:0/507082217 wait complete. 2024-08-17T02:30:54.658 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:30:54.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.808+0000 7f128cc00640 1 Processor -- start 2024-08-17T02:30:54.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.808+0000 7f128cc00640 1 -- start start 2024-08-17T02:30:54.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.809+0000 7f128cc00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1288158b90 0x7f12880b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.809+0000 7f128cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12880b2370 0x7f12880aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.809+0000 7f128cc00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f12880aef60 0x7f1288068630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.809+0000 7f128cc00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880af380 con 0x7f12880aef60 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.809+0000 7f128cc00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880afd20 con 0x7f1288158b90 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.809+0000 7f128cc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12880affe0 con 0x7f12880b2370 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f12880aef60 0x7f1288068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f12880aef60 0x7f1288068630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56480/0 (socket says 172.21.15.42:56480) 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 -- 172.21.15.42:0/2679872550 learned_addr learned my addr 172.21.15.42:0/2679872550 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:54.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1285e00640 1 --2- 172.21.15.42:0/2679872550 >> v2:172.21.15.62:3300/0 conn(0x7f1288158b90 0x7f12880b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f127fe00640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12880b2370 0x7f12880aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 -- 172.21.15.42:0/2679872550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12880b2370 msgr2=0x7f12880aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12880b2370 0x7f12880aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 -- 172.21.15.42:0/2679872550 >> v2:172.21.15.62:3300/0 conn(0x7f1288158b90 msgr2=0x7f12880b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 --2- 172.21.15.42:0/2679872550 >> v2:172.21.15.62:3300/0 conn(0x7f1288158b90 0x7f12880b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f1286800640 1 -- 172.21.15.42:0/2679872550 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880b02c0 con 0x7f12880aef60 2024-08-17T02:30:54.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.810+0000 7f127fe00640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12880b2370 0x7f12880aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.811+0000 7f1286800640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880aef60 0x7f1288068630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f12880cd650 tx=0x7f1280009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6171a69553414e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.811+0000 7f1285400640 1 -- 172.21.15.42:0/2679872550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280031400 con 0x7f12880aef60 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.811+0000 7f1285400640 1 -- 172.21.15.42:0/2679872550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128002d050 con 0x7f12880aef60 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.811+0000 7f1285400640 1 -- 172.21.15.42:0/2679872550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12800317d0 con 0x7f12880aef60 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 -- 172.21.15.42:0/2679872550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880aef60 msgr2=0x7f1288068630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880aef60 0x7f1288068630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f12880cd650 tx=0x7f1280009840 comp rx=0 tx=0).stop 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 -- 172.21.15.42:0/2679872550 shutdown_connections 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880aef60 0x7f1288068630 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 --2- 172.21.15.42:0/2679872550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12880b2370 0x7f12880aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 --2- 172.21.15.42:0/2679872550 >> v2:172.21.15.62:3300/0 conn(0x7f1288158b90 0x7f12880b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 -- 172.21.15.42:0/2679872550 >> 172.21.15.42:0/2679872550 conn(0x7f128806e590 msgr2=0x7f128806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 -- 172.21.15.42:0/2679872550 shutdown_connections 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.812+0000 7f128cc00640 1 -- 172.21.15.42:0/2679872550 wait complete. 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.813+0000 7f128cc00640 1 Processor -- start 2024-08-17T02:30:54.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.814+0000 7f128cc00640 1 -- start start 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f128cc00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12880aef60 0x7f128816cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f128cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 0x7f1288158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f128cc00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1288158b90 0x7f1288168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f128cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128816d130 con 0x7f12880b2370 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f128cc00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128815b570 con 0x7f12880aef60 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f128cc00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1288158f60 con 0x7f1288158b90 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 0x7f1288158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 0x7f1288158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56494/0 (socket says 172.21.15.42:56494) 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 -- 172.21.15.42:0/3209822629 learned_addr learned my addr 172.21.15.42:0/3209822629 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f1285e00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12880aef60 0x7f128816cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 -- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1288158b90 msgr2=0x7f1288168cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1288158b90 0x7f1288168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 -- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12880aef60 msgr2=0x7f128816cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12880aef60 0x7f128816cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 -- 172.21.15.42:0/3209822629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280009ae0 con 0x7f12880b2370 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.815+0000 7f127fe00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 0x7f1288158050 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f127000d890 tx=0x7f1270008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.816+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000de80 con 0x7f12880b2370 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.816+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000b8d0 con 0x7f12880b2370 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.816+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000bc90 con 0x7f12880b2370 2024-08-17T02:30:54.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.816+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1288159240 con 0x7f12880b2370 2024-08-17T02:30:54.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.816+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1288159800 con 0x7f12880b2370 2024-08-17T02:30:54.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.817+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128806f360 con 0x7f12880b2370 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.818+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f127001e460 con 0x7f12880b2370 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.819+0000 7f127d600640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1264065150 0x7f1264067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.819+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1270082930 con 0x7f12880b2370 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.819+0000 7f1285e00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1264065150 0x7f1264067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.819+0000 7f1285e00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1264065150 0x7f1264067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1278009360 tx=0x7f1278008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:54.823+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f128806f360 con 0x7f12880b2370 2024-08-17T02:30:55.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.004+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f128806f360 con 0x7f1264065150 2024-08-17T02:30:55.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.004+0000 7f127d600640 1 -- 172.21.15.42:0/3209822629 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f128806f360 con 0x7f1264065150 2024-08-17T02:30:55.006 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:30:55.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1264065150 msgr2=0x7f1264067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1264065150 0x7f1264067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1278009360 tx=0x7f1278008040 comp rx=0 tx=0).stop 2024-08-17T02:30:55.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 msgr2=0x7f1288158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 0x7f1288158050 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f127000d890 tx=0x7f1270008040 comp rx=0 tx=0).stop 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 shutdown_connections 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f1264065150 0x7f1264067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1288158b90 0x7f1288168cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12880b2370 0x7f1288158050 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 --2- 172.21.15.42:0/3209822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12880aef60 0x7f128816cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.006+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 >> 172.21.15.42:0/3209822629 conn(0x7f128806e590 msgr2=0x7f12880cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.007+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 shutdown_connections 2024-08-17T02:30:55.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.007+0000 7f128cc00640 1 -- 172.21.15.42:0/3209822629 wait complete. 2024-08-17T02:30:55.023 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:30:55.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:55.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.176+0000 7fb787800640 1 Processor -- start 2024-08-17T02:30:55.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.176+0000 7fb787800640 1 -- start start 2024-08-17T02:30:55.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.177+0000 7fb787800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb780156a90 0x7fb7800ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.177+0000 7fb787800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7801582b0 con 0x7fb7800aef00 2024-08-17T02:30:55.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.177+0000 7fb787800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7800ca110 con 0x7fb7800adba0 2024-08-17T02:30:55.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.177+0000 7fb787800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800c9f80 con 0x7fb780156a90 2024-08-17T02:30:55.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb784e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb780156a90 0x7fb7800ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb784e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb780156a90 0x7fb7800ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56504/0 (socket says 172.21.15.42:56504) 2024-08-17T02:30:55.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb785800640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb7800aef00 0x7fb7800ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43446/0 (socket says 172.21.15.42:43446) 2024-08-17T02:30:55.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb784e00640 1 -- 172.21.15.42:0/3357516190 learned_addr learned my addr 172.21.15.42:0/3357516190 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb784e00640 1 -- 172.21.15.42:0/3357516190 >> v1:172.21.15.62:6789/0 conn(0x7fb7800adba0 legacy=0x7fb7800ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb784e00640 1 -- 172.21.15.42:0/3357516190 >> v1:172.21.15.42:6789/0 conn(0x7fb7800aef00 legacy=0x7fb7800ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb77f400640 1 -- 172.21.15.42:0/3357516190 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264264030 0 0) 0x7fb7801582b0 con 0x7fb7800aef00 2024-08-17T02:30:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.178+0000 7fb784e00640 1 -- 172.21.15.42:0/3357516190 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800adff0 con 0x7fb780156a90 2024-08-17T02:30:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.179+0000 7fb784e00640 1 --2- 172.21.15.42:0/3357516190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800ad660 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb774009910 tx=0x7fb7740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb85b490200ef0d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb77f400640 1 -- 172.21.15.42:0/3357516190 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774032440 con 0x7fb780156a90 2024-08-17T02:30:55.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb77f400640 1 -- 172.21.15.42:0/3357516190 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7740325a0 con 0x7fb780156a90 2024-08-17T02:30:55.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb77f400640 1 -- 172.21.15.42:0/3357516190 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774032940 con 0x7fb780156a90 2024-08-17T02:30:55.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 -- 172.21.15.42:0/3357516190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 msgr2=0x7fb7800ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 --2- 172.21.15.42:0/3357516190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800ad660 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb774009910 tx=0x7fb7740091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 -- 172.21.15.42:0/3357516190 shutdown_connections 2024-08-17T02:30:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 --2- 172.21.15.42:0/3357516190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800ad660 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 -- 172.21.15.42:0/3357516190 >> 172.21.15.42:0/3357516190 conn(0x7fb780066e60 msgr2=0x7fb780067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 -- 172.21.15.42:0/3357516190 shutdown_connections 2024-08-17T02:30:55.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.180+0000 7fb787800640 1 -- 172.21.15.42:0/3357516190 wait complete. 2024-08-17T02:30:55.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.182+0000 7fb787800640 1 Processor -- start 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.182+0000 7fb787800640 1 -- start start 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb787800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7800adba0 0x7fb780141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb787800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7800aef00 0x7fb7800cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb787800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb787800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb780148d00 con 0x7fb780156a90 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb787800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb780145730 con 0x7fb7800aef00 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb787800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb780144690 con 0x7fb7800adba0 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb785800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb784e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7800adba0 0x7fb780141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb785800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56506/0 (socket says 172.21.15.42:56506) 2024-08-17T02:30:55.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb785800640 1 -- 172.21.15.42:0/2546723560 learned_addr learned my addr 172.21.15.42:0/2546723560 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.183+0000 7fb77fe00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7800aef00 0x7fb7800cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb785800640 1 -- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7800adba0 msgr2=0x7fb780141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb785800640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7800adba0 0x7fb780141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb785800640 1 -- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7800aef00 msgr2=0x7fb7800cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb785800640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7800aef00 0x7fb7800cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb785800640 1 -- 172.21.15.42:0/2546723560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009450 con 0x7fb780156a90 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb785800640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800cb970 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c960 tx=0x7fb7780016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778005d60 con 0x7fb780156a90 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800a640 con 0x7fb780156a90 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800aa00 con 0x7fb780156a90 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb780144970 con 0x7fb780156a90 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.184+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb780144f30 con 0x7fb780156a90 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.185+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb780063fb0 con 0x7fb780156a90 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.186+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb7780070f0 con 0x7fb780156a90 2024-08-17T02:30:55.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.187+0000 7fb773e00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb760065150 0x7fb760067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.187+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb778081ef0 con 0x7fb780156a90 2024-08-17T02:30:55.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.187+0000 7fb773e00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fb76006b040 0x7fb76006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.187+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 --> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb76006db00 con 0x7fb76006b040 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.187+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7780843f0 con 0x7fb780156a90 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.187+0000 7fb784e00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb760065150 0x7fb760067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.188+0000 7fb77fe00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fb76006b040 0x7fb76006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.188+0000 7fb784e00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb760065150 0x7fb760067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb774034000 tx=0x7fb774032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.189+0000 7fb77fe00640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fb76006b040 0x7fb76006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.189+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== osd.6 v2:172.21.15.62:6824/37406 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb76006db00 con 0x7fb76006b040 2024-08-17T02:30:55.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.202+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 --> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7800c8fa0 con 0x7fb76006b040 2024-08-17T02:30:55.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb773e00640 1 -- 172.21.15.42:0/2546723560 <== osd.6 v2:172.21.15.62:6824/37406 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb7800c8fa0 con 0x7fb76006b040 2024-08-17T02:30:55.204 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:55.205 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:55.205 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fb76006b040 msgr2=0x7fb76006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.62:6824/37406,v1:172.21.15.62:6825/37406] conn(0x7fb76006b040 0x7fb76006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb760065150 msgr2=0x7fb760067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fb760065150 0x7fb760067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb774034000 tx=0x7fb774032000 comp rx=0 tx=0).stop 2024-08-17T02:30:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 msgr2=0x7fb7800cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 --2- 172.21.15.42:0/2546723560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb780156a90 0x7fb7800cb970 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c960 tx=0x7fb7780016c0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb785800640 1 -- 172.21.15.42:0/2546723560 reap_dead start 2024-08-17T02:30:55.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 shutdown_connections 2024-08-17T02:30:55.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.203+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 >> 172.21.15.42:0/2546723560 conn(0x7fb780066e60 msgr2=0x7fb780153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.204+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 shutdown_connections 2024-08-17T02:30:55.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.204+0000 7fb787800640 1 -- 172.21.15.42:0/2546723560 wait complete. 2024-08-17T02:30:55.219 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:30:55.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.370+0000 7f9aace00640 1 Processor -- start 2024-08-17T02:30:55.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.370+0000 7f9aace00640 1 -- start start 2024-08-17T02:30:55.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.371+0000 7f9aace00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9aa81590b0 0x7f9aa80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.371+0000 7f9aace00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa80c92b0 con 0x7f9aa80afca0 2024-08-17T02:30:55.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.371+0000 7f9aace00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa80ad480 con 0x7f9aa80acf10 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.371+0000 7f9aace00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80b0980 con 0x7f9aa81590b0 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.372+0000 7f9a9d400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9aa81590b0 0x7f9aa80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.372+0000 7f9a9d400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9aa81590b0 0x7f9aa80b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56514/0 (socket says 172.21.15.42:56514) 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.372+0000 7f9a9d400640 1 -- 172.21.15.42:0/2707498455 learned_addr learned my addr 172.21.15.42:0/2707498455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.372+0000 7f9a9d400640 1 -- 172.21.15.42:0/2707498455 >> v1:172.21.15.62:6789/0 conn(0x7f9aa80acf10 legacy=0x7f9aa80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.372+0000 7f9a9d400640 1 -- 172.21.15.42:0/2707498455 >> v1:172.21.15.42:6789/0 conn(0x7f9aa80afca0 legacy=0x7f9aa81589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.372+0000 7f9a9d400640 1 -- 172.21.15.42:0/2707498455 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80ad760 con 0x7f9aa81590b0 2024-08-17T02:30:55.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.373+0000 7f9a9d400640 1 --2- 172.21.15.42:0/2707498455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa81590b0 0x7f9aa80b0070 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009910 tx=0x7f9a900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1391201eef1a9e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.373+0000 7f9aa5400640 1 -- 172.21.15.42:0/2707498455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9002ae70 con 0x7f9aa81590b0 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.373+0000 7f9aa5400640 1 -- 172.21.15.42:0/2707498455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a90032440 con 0x7f9aa81590b0 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.373+0000 7f9aa5400640 1 -- 172.21.15.42:0/2707498455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90032820 con 0x7f9aa81590b0 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 -- 172.21.15.42:0/2707498455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa81590b0 msgr2=0x7f9aa80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 --2- 172.21.15.42:0/2707498455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa81590b0 0x7f9aa80b0070 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009910 tx=0x7f9a900091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 -- 172.21.15.42:0/2707498455 shutdown_connections 2024-08-17T02:30:55.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 --2- 172.21.15.42:0/2707498455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa81590b0 0x7f9aa80b0070 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 -- 172.21.15.42:0/2707498455 >> 172.21.15.42:0/2707498455 conn(0x7f9aa8066e60 msgr2=0x7f9aa8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 -- 172.21.15.42:0/2707498455 shutdown_connections 2024-08-17T02:30:55.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.374+0000 7f9aace00640 1 -- 172.21.15.42:0/2707498455 wait complete. 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.375+0000 7f9aace00640 1 Processor -- start 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 -- start start 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 0x7f9aa80c07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9aa80afca0 0x7f9aa80c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9aa81590b0 0x7f9aa8144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8148160 con 0x7f9aa80acf10 2024-08-17T02:30:55.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8147550 con 0x7f9aa81590b0 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.376+0000 7f9aace00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8147830 con 0x7f9aa80afca0 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 0x7f9aa80c07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 0x7f9aa80c07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56528/0 (socket says 172.21.15.42:56528) 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 -- 172.21.15.42:0/3982197389 learned_addr learned my addr 172.21.15.42:0/3982197389 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 -- 172.21.15.42:0/3982197389 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9aa80afca0 msgr2=0x7f9aa80c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9aa80afca0 0x7f9aa80c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 -- 172.21.15.42:0/3982197389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9aa81590b0 msgr2=0x7f9aa8144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9aa81590b0 0x7f9aa8144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 -- 172.21.15.42:0/3982197389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009450 con 0x7f9aa80acf10 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.377+0000 7f9aa5e00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 0x7f9aa80c07e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c560 tx=0x7f9a98007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.378+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011590 con 0x7f9aa80acf10 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.378+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a980116f0 con 0x7f9aa80acf10 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.378+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011af0 con 0x7f9aa80acf10 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.378+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa8147b10 con 0x7f9aa80acf10 2024-08-17T02:30:55.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.378+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa8147170 con 0x7f9aa80acf10 2024-08-17T02:30:55.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.379+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa806e7e0 con 0x7f9aa80acf10 2024-08-17T02:30:55.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.380+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9a9801b3b0 con 0x7f9aa80acf10 2024-08-17T02:30:55.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.381+0000 7f9a9e000640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9a84065150 0x7f9a84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.381+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9a98081750 con 0x7f9aa80acf10 2024-08-17T02:30:55.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.381+0000 7f9a9d400640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9a84065150 0x7f9a84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.382+0000 7f9a9d400640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9a84065150 0x7f9a84067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a90034000 tx=0x7f9a90032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.385+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9aa806e7e0 con 0x7f9aa80acf10 2024-08-17T02:30:55.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.566+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aa81482a0 con 0x7f9a84065150 2024-08-17T02:30:55.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.566+0000 7f9a9e000640 1 -- 172.21.15.42:0/3982197389 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a90032640 con 0x7f9a84065150 2024-08-17T02:30:55.568 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:30:55.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9a84065150 msgr2=0x7f9a84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9a84065150 0x7f9a84067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a90034000 tx=0x7f9a90032000 comp rx=0 tx=0).stop 2024-08-17T02:30:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 msgr2=0x7f9aa80c07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 0x7f9aa80c07e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800c560 tx=0x7f9a98007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 shutdown_connections 2024-08-17T02:30:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f9a84065150 0x7f9a84067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9aa81590b0 0x7f9aa8144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9aa80afca0 0x7f9aa80c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 --2- 172.21.15.42:0/3982197389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9aa80acf10 0x7f9aa80c07e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 >> 172.21.15.42:0/3982197389 conn(0x7f9aa8066e60 msgr2=0x7f9aa81594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 shutdown_connections 2024-08-17T02:30:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.568+0000 7f9aace00640 1 -- 172.21.15.42:0/3982197389 wait complete. 2024-08-17T02:30:55.584 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:30:55.585 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:30:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.739+0000 7f0557200640 1 Processor -- start 2024-08-17T02:30:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.739+0000 7f0557200640 1 -- start start 2024-08-17T02:30:55.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0557200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ad780 0x7f05580adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0557200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05580ae6e0 0x7f0558157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0557200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05580ca060 con 0x7f05580cae20 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0557200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05580ca340 con 0x7f05580ae6e0 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0557200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05580ca620 con 0x7f05580ad780 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05580ae6e0 0x7f0558157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05580ae6e0 0x7f0558157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56530/0 (socket says 172.21.15.42:56530) 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 -- 172.21.15.42:0/211502486 learned_addr learned my addr 172.21.15.42:0/211502486 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0555400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f05580cae20 0x7f05580af6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43460/0 (socket says 172.21.15.42:43460) 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0555e00640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ad780 0x7f05580adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 -- 172.21.15.42:0/211502486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ad780 msgr2=0x7f05580adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ad780 0x7f05580adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 -- 172.21.15.42:0/211502486 >> v1:172.21.15.42:6789/0 conn(0x7f05580cae20 legacy=0x7f05580af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0556800640 1 -- 172.21.15.42:0/211502486 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580ca900 con 0x7f05580ae6e0 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0555e00640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ad780 0x7f05580adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:55.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.741+0000 7f0554a00640 1 -- 172.21.15.42:0/211502486 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474230943 0 0) 0x7f05580ca060 con 0x7f05580cae20 2024-08-17T02:30:55.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.742+0000 7f0556800640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ae6e0 0x7f0558157100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0550009f20 tx=0x7f0550009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d8ffcdefad467 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0554a00640 1 -- 172.21.15.42:0/211502486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550031400 con 0x7f05580ae6e0 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0554a00640 1 -- 172.21.15.42:0/211502486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055002d050 con 0x7f05580ae6e0 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0554a00640 1 -- 172.21.15.42:0/211502486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550031790 con 0x7f05580ae6e0 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 -- 172.21.15.42:0/211502486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ae6e0 msgr2=0x7f0558157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ae6e0 0x7f0558157100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0550009f20 tx=0x7f0550009840 comp rx=0 tx=0).stop 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 -- 172.21.15.42:0/211502486 shutdown_connections 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ae6e0 0x7f0558157100 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 --2- 172.21.15.42:0/211502486 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ad780 0x7f05580adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 -- 172.21.15.42:0/211502486 >> 172.21.15.42:0/211502486 conn(0x7f0558066e60 msgr2=0x7f0558067230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 -- 172.21.15.42:0/211502486 shutdown_connections 2024-08-17T02:30:55.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.743+0000 7f0557200640 1 -- 172.21.15.42:0/211502486 wait complete. 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.745+0000 7f0557200640 1 Processor -- start 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.745+0000 7f0557200640 1 -- start start 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0557200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ad780 0x7f0558140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0557200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ae6e0 0x7f05581412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0557200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05580cae20 0x7f05581576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0557200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558141090 con 0x7f05580ad780 2024-08-17T02:30:55.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0557200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558158cc0 con 0x7f05580cae20 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0557200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05581580b0 con 0x7f05580ae6e0 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0555e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ad780 0x7f0558140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0555e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ad780 0x7f0558140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56542/0 (socket says 172.21.15.42:56542) 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0555e00640 1 -- 172.21.15.42:0/3318825542 learned_addr learned my addr 172.21.15.42:0/3318825542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0556800640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05580cae20 0x7f05581576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.746+0000 7f0555400640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ae6e0 0x7f05581412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0555e00640 1 -- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ae6e0 msgr2=0x7f05581412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0555e00640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05580ae6e0 0x7f05581412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0555e00640 1 -- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05580cae20 msgr2=0x7f05581576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0555e00640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05580cae20 0x7f05581576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0555e00640 1 -- 172.21.15.42:0/3318825542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550009ae0 con 0x7f05580ad780 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0555e00640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ad780 0x7f0558140b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f054800d890 tx=0x7f0548008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054800de80 con 0x7f05580ad780 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054800b8d0 con 0x7f05580ad780 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054800bc90 con 0x7f05580ad780 2024-08-17T02:30:55.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0558158390 con 0x7f05580ad780 2024-08-17T02:30:55.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.747+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0558158950 con 0x7f05580ad780 2024-08-17T02:30:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.748+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0558063f10 con 0x7f05580ad780 2024-08-17T02:30:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.749+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f054801e460 con 0x7f05580ad780 2024-08-17T02:30:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.750+0000 7f054d600640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0538065150 0x7f0538067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.750+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f05480827c0 con 0x7f05580ad780 2024-08-17T02:30:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.751+0000 7f0555400640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0538065150 0x7f0538067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.751+0000 7f054d600640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f053806b040 0x7f053806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.751+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 --> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f053806db00 con 0x7f053806b040 2024-08-17T02:30:55.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.751+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0548084cc0 con 0x7f05580ad780 2024-08-17T02:30:55.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.751+0000 7f0556800640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f053806b040 0x7f053806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.751+0000 7f0555400640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0538065150 0x7f0538067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f055814fb60 tx=0x7f0544007e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.752+0000 7f0556800640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f053806b040 0x7f053806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.753+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== osd.7 v2:172.21.15.62:6816/37391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f053806db00 con 0x7f053806b040 2024-08-17T02:30:55.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.765+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 --> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f055806b520 con 0x7f053806b040 2024-08-17T02:30:55.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f054d600640 1 -- 172.21.15.42:0/3318825542 <== osd.7 v2:172.21.15.62:6816/37391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f055806b520 con 0x7f053806b040 2024-08-17T02:30:55.767 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-08-17T02:30:55.767 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:30:55.768 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-08-17T02:30:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f053806b040 msgr2=0x7f053806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0557200640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.62:6816/37391,v1:172.21.15.62:6817/37391] conn(0x7f053806b040 0x7f053806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0538065150 msgr2=0x7f0538067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0557200640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0538065150 0x7f0538067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f055814fb60 tx=0x7f0544007e60 comp rx=0 tx=0).stop 2024-08-17T02:30:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ad780 msgr2=0x7f0558140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0557200640 1 --2- 172.21.15.42:0/3318825542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05580ad780 0x7f0558140b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f054800d890 tx=0x7f0548008040 comp rx=0 tx=0).stop 2024-08-17T02:30:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.766+0000 7f0556800640 1 -- 172.21.15.42:0/3318825542 reap_dead start 2024-08-17T02:30:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.767+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 shutdown_connections 2024-08-17T02:30:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.767+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 >> 172.21.15.42:0/3318825542 conn(0x7f0558066e60 msgr2=0x7f055806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.767+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 shutdown_connections 2024-08-17T02:30:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.767+0000 7f0557200640 1 -- 172.21.15.42:0/3318825542 wait complete. 2024-08-17T02:30:55.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:30:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.932+0000 7fec77e00640 1 Processor -- start 2024-08-17T02:30:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.932+0000 7fec77e00640 1 -- start start 2024-08-17T02:30:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec780aed20 0x7fec78156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 0x7fec780cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7815b240 con 0x7fec780cc5a0 2024-08-17T02:30:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7815a630 con 0x7fec780aed20 2024-08-17T02:30:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815a910 con 0x7fec780af0f0 2024-08-17T02:30:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fec780cc5a0 0x7fec78155e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43466/0 (socket says 172.21.15.42:43466) 2024-08-17T02:30:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec77400640 1 -- 172.21.15.42:0/1819869243 learned_addr learned my addr 172.21.15.42:0/1819869243 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:55.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec76a00640 1 --2- 172.21.15.42:0/1819869243 >> v2:172.21.15.62:3300/0 conn(0x7fec780aed20 0x7fec78156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec6fe00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 0x7fec780cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924106618 0 0) 0x7fec7815b240 con 0x7fec780cc5a0 2024-08-17T02:30:55.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.934+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec5c0034e0 con 0x7fec780cc5a0 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976420559 0 0) 0x7fec5c0034e0 con 0x7fec780cc5a0 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 msgr2=0x7fec780cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 0x7fec780cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 >> v2:172.21.15.62:3300/0 conn(0x7fec780aed20 msgr2=0x7fec78156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 --2- 172.21.15.42:0/1819869243 >> v2:172.21.15.62:3300/0 conn(0x7fec780aed20 0x7fec78156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7815abf0 con 0x7fec780cc5a0 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7fec700017f0 con 0x7fec780cc5a0 2024-08-17T02:30:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 >> v1:172.21.15.42:6789/0 conn(0x7fec780cc5a0 legacy=0x7fec78155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5c0039d0 0x7fec5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec5c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 0x7fec5c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815a630 con 0x7fec5c004780 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7815a910 con 0x7fec5c0039d0 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c00b9d0 con 0x7fec780af0f0 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec6fe00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec5c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec76a00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5c0039d0 0x7fec5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec77400640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 0x7fec5c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.935+0000 7fec6fe00640 1 -- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 msgr2=0x7fec5c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.936+0000 7fec6fe00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec780af0f0 0x7fec5c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.936+0000 7fec6fe00640 1 -- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5c0039d0 msgr2=0x7fec5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.936+0000 7fec6fe00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5c0039d0 0x7fec5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.936+0000 7fec6fe00640 1 -- 172.21.15.42:0/1819869243 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0034e0 con 0x7fec5c004780 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.936+0000 7fec6fe00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec5c004bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fec60009ba0 tx=0x7fec600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b50d81ee3f80c49 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60031400 con 0x7fec5c004780 2024-08-17T02:30:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6002d050 con 0x7fec5c004780 2024-08-17T02:30:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec76000640 1 -- 172.21.15.42:0/1819869243 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60031790 con 0x7fec5c004780 2024-08-17T02:30:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec77e00640 1 -- 172.21.15.42:0/1819869243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 msgr2=0x7fec5c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec77e00640 1 --2- 172.21.15.42:0/1819869243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec5c004bf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fec60009ba0 tx=0x7fec600090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec77400640 1 -- 172.21.15.42:0/1819869243 reap_dead start 2024-08-17T02:30:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec77e00640 1 -- 172.21.15.42:0/1819869243 shutdown_connections 2024-08-17T02:30:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec77e00640 1 -- 172.21.15.42:0/1819869243 >> 172.21.15.42:0/1819869243 conn(0x7fec7806e590 msgr2=0x7fec7806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.937+0000 7fec77e00640 1 -- 172.21.15.42:0/1819869243 shutdown_connections 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.938+0000 7fec77e00640 1 -- 172.21.15.42:0/1819869243 wait complete. 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.939+0000 7fec77e00640 1 Processor -- start 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.939+0000 7fec77e00640 1 -- start start 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec7814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec780b4680 0x7fec780b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec7814c540 0x7fec7814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c7bd0 con 0x7fec5c004780 2024-08-17T02:30:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7814cf00 con 0x7fec780b4680 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780c6fc0 con 0x7fec7814c540 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec7814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec7814a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56572/0 (socket says 172.21.15.42:56572) 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 -- 172.21.15.42:0/3050734527 learned_addr learned my addr 172.21.15.42:0/3050734527 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77400640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec7814c540 0x7fec7814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 -- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec7814c540 msgr2=0x7fec7814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec6fe00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec780b4680 0x7fec780b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec7814c540 0x7fec7814c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 -- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec780b4680 msgr2=0x7fec780b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec780b4680 0x7fec780b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec76a00640 1 -- 172.21.15.42:0/3050734527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780c72a0 con 0x7fec5c004780 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec77400640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec7814c540 0x7fec7814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.940+0000 7fec6fe00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec780b4680 0x7fec780b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.941+0000 7fec76a00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec7814a980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fec68011b40 tx=0x7fec680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.941+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6800fb00 con 0x7fec5c004780 2024-08-17T02:30:55.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.941+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6800fc60 con 0x7fec5c004780 2024-08-17T02:30:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.941+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec780c7580 con 0x7fec5c004780 2024-08-17T02:30:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.941+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68014440 con 0x7fec5c004780 2024-08-17T02:30:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.941+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7814aec0 con 0x7fec5c004780 2024-08-17T02:30:55.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.942+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec78070720 con 0x7fec5c004780 2024-08-17T02:30:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.943+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fec680147f0 con 0x7fec5c004780 2024-08-17T02:30:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.944+0000 7fec6e000640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fec54065150 0x7fec54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.944+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fec68018030 con 0x7fec5c004780 2024-08-17T02:30:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.945+0000 7fec6fe00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fec54065150 0x7fec54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.945+0000 7fec6fe00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fec54065150 0x7fec54067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec60034000 tx=0x7fec60035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:55.948+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fec68084e60 con 0x7fec5c004780 2024-08-17T02:30:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.129+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fec780c7d10 con 0x7fec54065150 2024-08-17T02:30:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.130+0000 7fec6e000640 1 -- 172.21.15.42:0/3050734527 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fec60040070 con 0x7fec54065150 2024-08-17T02:30:56.131 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:30:56.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fec54065150 msgr2=0x7fec54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fec54065150 0x7fec54067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec60034000 tx=0x7fec60035000 comp rx=0 tx=0).stop 2024-08-17T02:30:56.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 msgr2=0x7fec7814a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec7814a980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fec68011b40 tx=0x7fec680090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 shutdown_connections 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7fec54065150 0x7fec54067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec7814c540 0x7fec7814c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec780b4680 0x7fec780b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 --2- 172.21.15.42:0/3050734527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec5c004780 0x7fec7814a980 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 >> 172.21.15.42:0/3050734527 conn(0x7fec7806e590 msgr2=0x7fec7815c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 shutdown_connections 2024-08-17T02:30:56.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.132+0000 7fec77e00640 1 -- 172.21.15.42:0/3050734527 wait complete. 2024-08-17T02:30:56.147 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:56.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.298+0000 7f236b600640 1 Processor -- start 2024-08-17T02:30:56.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.298+0000 7f236b600640 1 -- start start 2024-08-17T02:30:56.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.299+0000 7f236b600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f23640b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.299+0000 7f236b600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640c92b0 con 0x7f23640afca0 2024-08-17T02:30:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.299+0000 7f236b600640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640ad480 con 0x7f23641590b0 2024-08-17T02:30:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.299+0000 7f236b600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b0980 con 0x7f23640acf10 2024-08-17T02:30:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.299+0000 7f2368c00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f23640afca0 0x7f23641589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:43468/0 (socket says 172.21.15.42:43468) 2024-08-17T02:30:56.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.299+0000 7f2368c00640 1 -- 172.21.15.42:0/1117632286 learned_addr learned my addr 172.21.15.42:0/1117632286 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:30:56.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2369600640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f23640b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705586537 0 0) 0x7f23640c92b0 con 0x7f23640afca0 2024-08-17T02:30:56.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c0034e0 con 0x7f23640afca0 2024-08-17T02:30:56.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256829071 0 0) 0x7f234c0034e0 con 0x7f23640afca0 2024-08-17T02:30:56.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 msgr2=0x7f23640b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:56.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f23640b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 >> v1:172.21.15.62:6789/0 conn(0x7f23641590b0 legacy=0x7f23640c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640ad760 con 0x7f23640afca0 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f2358001470 con 0x7f23640afca0 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 >> v1:172.21.15.42:6789/0 conn(0x7f23640afca0 legacy=0x7f23641589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f234c003a00 0x7f234c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c004780 0x7f234c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f234c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00bb60 con 0x7f234c003a00 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00bca0 con 0x7f234c004780 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.300+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00e040 con 0x7f23640acf10 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2368c00640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f234c003a00 0x7f234c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2363e00640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c004780 0x7f234c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2369600640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f234c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2368c00640 1 -- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 msgr2=0x7f234c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2368c00640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f234c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2368c00640 1 -- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c004780 msgr2=0x7f234c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:56.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2368c00640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c004780 0x7f234c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2368c00640 1 -- 172.21.15.42:0/1117632286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0034e0 con 0x7f234c003a00 2024-08-17T02:30:56.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.301+0000 7f2369600640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640acf10 0x7f234c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:56.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.302+0000 7f2368c00640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f234c003a00 0x7f234c003e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f235800c190 tx=0x7f236406b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e1203fa6947b02 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.302+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358005890 con 0x7f234c003a00 2024-08-17T02:30:56.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.302+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235802d070 con 0x7f234c003a00 2024-08-17T02:30:56.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.302+0000 7f2363400640 1 -- 172.21.15.42:0/1117632286 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358005a50 con 0x7f234c003a00 2024-08-17T02:30:56.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f236b600640 1 -- 172.21.15.42:0/1117632286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f234c003a00 msgr2=0x7f234c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f236b600640 1 --2- 172.21.15.42:0/1117632286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f234c003a00 0x7f234c003e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f235800c190 tx=0x7f236406b930 comp rx=0 tx=0).stop 2024-08-17T02:30:56.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f2369600640 1 -- 172.21.15.42:0/1117632286 reap_dead start 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f236b600640 1 -- 172.21.15.42:0/1117632286 shutdown_connections 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f236b600640 1 -- 172.21.15.42:0/1117632286 >> 172.21.15.42:0/1117632286 conn(0x7f2364066e60 msgr2=0x7f2364067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f236b600640 1 -- 172.21.15.42:0/1117632286 shutdown_connections 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.303+0000 7f236b600640 1 -- 172.21.15.42:0/1117632286 wait complete. 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.304+0000 7f236b600640 1 Processor -- start 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 -- start start 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c003a00 0x7f2364142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640c7bd0 0x7f2364143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 0x7f23640c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640c6c60 con 0x7f2364143c90 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364143460 con 0x7f234c003a00 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.305+0000 7f236b600640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23640c6050 con 0x7f23640c7bd0 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 0x7f23640c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 0x7f23640c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56576/0 (socket says 172.21.15.42:56576) 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 -- 172.21.15.42:0/3727456813 learned_addr learned my addr 172.21.15.42:0/3727456813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:30:56.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2368c00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c003a00 0x7f2364142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2363e00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640c7bd0 0x7f2364143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 -- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640c7bd0 msgr2=0x7f2364143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640c7bd0 0x7f2364143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 -- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c003a00 msgr2=0x7f2364142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c003a00 0x7f2364142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 -- 172.21.15.42:0/3727456813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640c6330 con 0x7f2364143c90 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2363e00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640c7bd0 0x7f2364143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2368c00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c003a00 0x7f2364142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.306+0000 7f2369600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 0x7f23640c70f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23640cc910 tx=0x7f235c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.307+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00e030 con 0x7f2364143c90 2024-08-17T02:30:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.307+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c016680 con 0x7f2364143c90 2024-08-17T02:30:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.307+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c016a40 con 0x7f2364143c90 2024-08-17T02:30:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.307+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23640c6610 con 0x7f2364143c90 2024-08-17T02:30:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.307+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23640c5d20 con 0x7f2364143c90 2024-08-17T02:30:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.308+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640c6e10 con 0x7f2364143c90 2024-08-17T02:30:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.309+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f235c011460 con 0x7f2364143c90 2024-08-17T02:30:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.310+0000 7f2357e00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2344065180 0x7f2344067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.310+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f235c00f070 con 0x7f2364143c90 2024-08-17T02:30:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.310+0000 7f2368c00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2344065180 0x7f2344067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.311+0000 7f2368c00640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2344065180 0x7f2344067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2358032000 tx=0x7f2358033000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.314+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23640c6e10 con 0x7f2364143c90 2024-08-17T02:30:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.494+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2364063fb0 con 0x7f2344065180 2024-08-17T02:30:56.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.496+0000 7f2357e00640 1 -- 172.21.15.42:0/3727456813 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50574 (secure 0 0 0) 0x7f2364063fb0 con 0x7f2344065180 2024-08-17T02:30:56.498 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:30:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:30:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2344065180 msgr2=0x7f2344067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2344065180 0x7f2344067630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2358032000 tx=0x7f2358033000 comp rx=0 tx=0).stop 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 msgr2=0x7f23640c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 0x7f23640c70f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f23640cc910 tx=0x7f235c00b040 comp rx=0 tx=0).stop 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 shutdown_connections 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f2344065180 0x7f2344067630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364143c90 0x7f23640c70f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f23640c7bd0 0x7f2364143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 --2- 172.21.15.42:0/3727456813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f234c003a00 0x7f2364142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 >> 172.21.15.42:0/3727456813 conn(0x7f2364066e60 msgr2=0x7f236406acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 shutdown_connections 2024-08-17T02:30:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:30:56.498+0000 7f236b600640 1 -- 172.21.15.42:0/3727456813 wait complete. 2024-08-17T02:30:56.514 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:30:55.234936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400684,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574036,"statfs":{"total":773094113280,"available":770635812864,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001533"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:30:44.867773+0000","last_change":"2024-08-17T02:27:21.432154+0000","last_active":"2024-08-17T02:30:44.867773+0000","last_peered":"2024-08-17T02:30:44.867773+0000","last_clean":"2024-08-17T02:30:44.867773+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:30:44.867773+0000","last_undegraded":"2024-08-17T02:30:44.867773+0000","last_fullsized":"2024-08-17T02:30:44.867773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:20.163875+0000","last_clean_scrub_stamp":"2024-08-17T02:27:20.163875+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:58:05.021929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298436,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073404,"statfs":{"total":96636764160,"available":96331165696,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.754},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94099999999999995,"5min":2.097,"15min":2.097},"last":0.40600000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.435},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.67100000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59399999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96799999999999997,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70699999999999996,"15min":0.68500000000000005},"min":{"1min":0.67700000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.67500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.68500000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.016,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.76700000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.72499999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1,"5min":1.155,"15min":1.155},"last":0.624},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.093,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.627},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.873,"5min":1.885,"15min":1.885},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":1.964,"15min":1.964},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86899999999999999,"15min":0.91500000000000004},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.93899999999999995,"15min":1.0229999999999999},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":8.4610000000000003,"15min":8.4610000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.117,"15min":1.27},"min":{"1min":0.57299999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99199999999999999,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.79000000000000004,"15min":0.85799999999999998},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71299999999999997,"15min":0.753},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":4.548,"15min":4.548},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89300000000000002,"15min":0.97499999999999998},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.79600000000000004,"15min":0.82399999999999995},"min":{"1min":0.55900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0620000000000001,"5min":1.931,"15min":1.931},"last":0.79500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.98299999999999998,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.96499999999999997,"15min":1.079},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94699999999999995,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.024},"min":{"1min":0.53100000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":6.8970000000000002,"15min":6.8970000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.89800000000000002,"15min":0.96799999999999997},"min":{"1min":0.51700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0089999999999999,"15min":1.1259999999999999},"min":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":11.622,"15min":11.622},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.02,"15min":1.1439999999999999},"min":{"1min":0.496,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.747}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.98399999999999999,"15min":1.087},"min":{"1min":0.56000000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":9.6419999999999995,"15min":9.6419999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.98899999999999999,"15min":1.0860000000000001},"min":{"1min":0.61599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96799999999999997,"5min":6.7309999999999999,"15min":6.7309999999999999},"last":0.79200000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.82899999999999996,"15min":0.94499999999999995},"min":{"1min":0.42299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.77200000000000002,"15min":0.85699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92700000000000005,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.65800000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.86099999999999999,"15min":0.95199999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":5.242,"15min":5.242},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":1.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.621,"15min":1.621},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.92800000000000005,"15min":1.028},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.81999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.65900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.86099999999999999},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0369999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.64100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.048,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.59699999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":0.999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.627,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.23,"15min":1.23},"last":0.52300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.59099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99299999999999999,"5min":1.202,"15min":1.202},"last":0.73899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":1.171,"15min":1.171},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81699999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.621}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84199999999999997,"5min":1.175,"15min":1.175},"last":0.69799999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":1.149,"15min":1.149},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.876,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.80600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.0109999999999999,"15min":1.258},"min":{"1min":0.317,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69099999999999995,"5min":17.771000000000001,"15min":17.771000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.0489999999999999,"15min":1.3029999999999999},"min":{"1min":0.34100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":18.603999999999999,"15min":18.603999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.02,"15min":1.258},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.0740000000000001,"15min":1.2689999999999999},"min":{"1min":0.499,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":15.847,"15min":15.847},"last":0.45900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.135,"15min":1.3879999999999999},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":19.356999999999999,"15min":19.356999999999999},"last":0.442},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.115,"15min":1.3340000000000001},"min":{"1min":0.44400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83399999999999996,"5min":16.975999999999999,"15min":16.975999999999999},"last":0.29999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.99099999999999999,"15min":1.1020000000000001},"min":{"1min":0.57799999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.997,"5min":8.8320000000000007,"15min":8.8320000000000007},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.997,"15min":1.1040000000000001},"min":{"1min":0.57599999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.052,"5min":8.6509999999999998,"15min":8.6509999999999998},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.2370000000000001,"15min":1.4319999999999999},"min":{"1min":0.56699999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.999,"5min":15.153,"15min":15.153},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.0780000000000001,"15min":1.2170000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0660000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.0009999999999999,"15min":1.1040000000000001},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93000000000000005,"5min":7.9870000000000001,"15min":7.9870000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":1.0740000000000001},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.085,"5min":7.2629999999999999,"15min":7.2629999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0289999999999999,"5min":1.99,"15min":1.99},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.625,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1100000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.75,"15min":0.75},"last":0.33200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.436,"15min":0.433},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.378},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.60599999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0620000000000001,"5min":1.099,"15min":1.099},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76500000000000001,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.123,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.94499999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.198,"15min":1.198},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.131,"15min":1.131},"last":0.79900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80300000000000005,"15min":0.78900000000000003},"min":{"1min":0.67700000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.77000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86199999999999999,"5min":1.179,"15min":1.179},"last":0.56499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45000000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.69899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.286,"15min":1.286},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.069,"15min":1.069},"last":0.64800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.81100000000000005},"min":{"1min":0.63600000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.222,"15min":1.222},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.044,"5min":1.242,"15min":1.242},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98299999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.997,"5min":1.246,"15min":1.246},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302596,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069244,"statfs":{"total":96636764160,"available":96326905856,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63800000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77600000000000002,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58899999999999997,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76100000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82299999999999995,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.503},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.72499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82699999999999996,"15min":0.85499999999999998},"min":{"1min":0.58699999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94599999999999995,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.042,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.56399999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0700000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.046,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.623}]},{"osd":7,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.65300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.87,"15min":0.91500000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90900000000000003,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:56.517 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:27:20.163875+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=27, tm_sec=20, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=30, tm_sec=50, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:30:56.517 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:31:16.519 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:16.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.680+0000 7f58a3e00640 1 Processor -- start 2024-08-17T02:31:16.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.680+0000 7f58a3e00640 1 -- start start 2024-08-17T02:31:16.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.681+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158b10 0x7f58a40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.681+0000 7f58a3e00640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58a40b25c0 0x7f58a4066e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.681+0000 7f58a3e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40a9620 con 0x7f58a4158ee0 2024-08-17T02:31:16.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.681+0000 7f58a3e00640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a40aa420 con 0x7f58a40b25c0 2024-08-17T02:31:16.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.681+0000 7f58a3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40a9850 con 0x7f58a4158b10 2024-08-17T02:31:16.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a3400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f58a4158ee0 0x7f58a40aa8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57082/0 (socket says 172.21.15.42:57082) 2024-08-17T02:31:16.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a3400640 1 -- 172.21.15.42:0/73473171 learned_addr learned my addr 172.21.15.42:0/73473171 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:31:16.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2a00640 1 --2- 172.21.15.42:0/73473171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158b10 0x7f58a40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2000640 1 --2- 172.21.15.42:0/73473171 >> v2:172.21.15.62:3300/0 conn(0x7f58a40b25c0 0x7f58a4066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a1600640 1 -- 172.21.15.42:0/73473171 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858790537 0 0) 0x7f58a40a9620 con 0x7f58a4158ee0 2024-08-17T02:31:16.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a1600640 1 -- 172.21.15.42:0/73473171 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58880034e0 con 0x7f58a4158ee0 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2a00640 1 -- 172.21.15.42:0/73473171 >> v2:172.21.15.62:3300/0 conn(0x7f58a40b25c0 msgr2=0x7f58a4066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2a00640 1 --2- 172.21.15.42:0/73473171 >> v2:172.21.15.62:3300/0 conn(0x7f58a40b25c0 0x7f58a4066e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2a00640 1 -- 172.21.15.42:0/73473171 >> v1:172.21.15.42:6789/0 conn(0x7f58a4158ee0 legacy=0x7f58a40aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2a00640 1 -- 172.21.15.42:0/73473171 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4067c40 con 0x7f58a4158b10 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.682+0000 7f58a2000640 1 --2- 172.21.15.42:0/73473171 >> v2:172.21.15.62:3300/0 conn(0x7f58a40b25c0 0x7f58a4066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.683+0000 7f58a2a00640 1 --2- 172.21.15.42:0/73473171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158b10 0x7f58a40b2080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5894009880 tx=0x7f58940090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c168f78c9f1d972 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a1600640 1 -- 172.21.15.42:0/73473171 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589402ace0 con 0x7f58a4158b10 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a1600640 1 -- 172.21.15.42:0/73473171 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589402ae40 con 0x7f58a4158b10 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a1600640 1 -- 172.21.15.42:0/73473171 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894032650 con 0x7f58a4158b10 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 -- 172.21.15.42:0/73473171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158b10 msgr2=0x7f58a40b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 --2- 172.21.15.42:0/73473171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158b10 0x7f58a40b2080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5894009880 tx=0x7f58940090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 -- 172.21.15.42:0/73473171 shutdown_connections 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 --2- 172.21.15.42:0/73473171 >> v2:172.21.15.62:3300/0 conn(0x7f58a40b25c0 0x7f58a4066e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 --2- 172.21.15.42:0/73473171 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158b10 0x7f58a40b2080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 -- 172.21.15.42:0/73473171 >> 172.21.15.42:0/73473171 conn(0x7f58a4095a70 msgr2=0x7f58a4095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 -- 172.21.15.42:0/73473171 shutdown_connections 2024-08-17T02:31:16.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.684+0000 7f58a3e00640 1 -- 172.21.15.42:0/73473171 wait complete. 2024-08-17T02:31:16.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.686+0000 7f58a3e00640 1 Processor -- start 2024-08-17T02:31:16.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.686+0000 7f58a3e00640 1 -- start start 2024-08-17T02:31:16.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 0x7f58a41474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a4158b10 0x7f58a415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3e00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158ee0 0x7f58a4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4097c60 con 0x7f58a40b25c0 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3e00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4097df0 con 0x7f58a4158b10 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3e00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a415a180 con 0x7f58a4158ee0 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 0x7f58a41474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 0x7f58a41474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35220/0 (socket says 172.21.15.42:35220) 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 -- 172.21.15.42:0/584217412 learned_addr learned my addr 172.21.15.42:0/584217412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2000640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a4158b10 0x7f58a415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a3400640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158ee0 0x7f58a4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 -- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158ee0 msgr2=0x7f58a4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158ee0 0x7f58a4155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 -- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a4158b10 msgr2=0x7f58a415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a4158b10 0x7f58a415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2a00640 1 -- 172.21.15.42:0/584217412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009390 con 0x7f58a40b25c0 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.687+0000 7f58a2000640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a4158b10 0x7f58a415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:16.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.688+0000 7f58a2a00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 0x7f58a41474a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5894009360 tx=0x7f5894032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.688+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589403b610 con 0x7f58a40b25c0 2024-08-17T02:31:16.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.688+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589403b770 con 0x7f58a40b25c0 2024-08-17T02:31:16.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.688+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5894009390 con 0x7f58a40b25c0 2024-08-17T02:31:16.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.688+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589403bb30 con 0x7f58a40b25c0 2024-08-17T02:31:16.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.688+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a415a740 con 0x7f58a40b25c0 2024-08-17T02:31:16.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.689+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a4070720 con 0x7f58a40b25c0 2024-08-17T02:31:16.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.690+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5894043030 con 0x7f58a40b25c0 2024-08-17T02:31:16.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.691+0000 7f589a000640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5884065150 0x7f5884067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.691+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5894041070 con 0x7f58a40b25c0 2024-08-17T02:31:16.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.692+0000 7f58a2000640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5884065150 0x7f5884067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.692+0000 7f58a2000640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5884065150 0x7f5884067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5890009360 tx=0x7f5890008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.696+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5894070a90 con 0x7f58a40b25c0 2024-08-17T02:31:16.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.873+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 --> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58a41579c0 con 0x7f5884065150 2024-08-17T02:31:16.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.875+0000 7f589a000640 1 -- 172.21.15.42:0/584217412 <== mgr.4111 v2:172.21.15.42:6832/36609 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50567 (secure 0 0 0) 0x7f58a41579c0 con 0x7f5884065150 2024-08-17T02:31:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:31:16.878 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-08-17T02:31:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5884065150 msgr2=0x7f5884067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5884065150 0x7f5884067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5890009360 tx=0x7f5890008040 comp rx=0 tx=0).stop 2024-08-17T02:31:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 msgr2=0x7f58a41474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 0x7f58a41474a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5894009360 tx=0x7f5894032000 comp rx=0 tx=0).stop 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 shutdown_connections 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f5884065150 0x7f5884067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a4158ee0 0x7f58a4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a4158b10 0x7f58a415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 --2- 172.21.15.42:0/584217412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58a40b25c0 0x7f58a41474a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 >> 172.21.15.42:0/584217412 conn(0x7f58a4095a70 msgr2=0x7f58a40aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 shutdown_connections 2024-08-17T02:31:16.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:16.878+0000 7f58a3e00640 1 -- 172.21.15.42:0/584217412 wait complete. 2024-08-17T02:31:16.894 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-08-17T02:31:15.239203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400676,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574044,"statfs":{"total":773094113280,"available":770635821056,"internally_reserved":0,"allocated":5283840,"data_stored":2880488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002480"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:30:57.812698+0000","last_change":"2024-08-17T02:30:57.812665+0000","last_active":"2024-08-17T02:30:57.812698+0000","last_peered":"2024-08-17T02:30:57.812698+0000","last_clean":"2024-08-17T02:30:57.812698+0000","last_became_active":"2024-08-17T02:27:21.431348+0000","last_became_peered":"2024-08-17T02:27:21.431348+0000","last_unstale":"2024-08-17T02:30:57.812698+0000","last_undegraded":"2024-08-17T02:30:57.812698+0000","last_fullsized":"2024-08-17T02:30:57.812698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:30:57.812573+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:30:57.812573+0000","last_clean_scrub_stamp":"2024-08-17T02:30:57.812573+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:15.968068+0000","scrub_duration":0.0060280029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71199999999999997,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94099999999999995,"5min":2.097,"15min":2.097},"last":0.70499999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71799999999999997,"15min":0.68600000000000005},"min":{"1min":0.53200000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.873},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.67100000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.91100000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.83599999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.65200000000000002,"15min":0.63},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.76400000000000001},"min":{"1min":0.59399999999999997,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.96799999999999997,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.73599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.70699999999999996,"15min":0.68500000000000005},"min":{"1min":0.67700000000000005,"5min":0.503,"15min":0.503},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.67500000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61599999999999999,"15min":0.63900000000000001},"min":{"1min":0.41299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.433,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.50700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.016,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73699999999999999,"15min":0.76700000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.034,"5min":1.119,"15min":1.119},"last":0.48399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.504,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1,"5min":1.155,"15min":1.155},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0620000000000001,"5min":1.075,"15min":1.075},"last":0.53600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.52800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.093,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.78700000000000003},"min":{"1min":0.45600000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97199999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75900000000000001,"15min":0.77100000000000002},"min":{"1min":0.59199999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.873,"5min":1.885,"15min":1.885},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.629,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.76700000000000002},"min":{"1min":0.495,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":1.964,"15min":1.964},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86899999999999999,"15min":0.91500000000000004},"min":{"1min":0.58799999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":0.54800000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.93899999999999995,"15min":1.0229999999999999},"min":{"1min":0.51600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0129999999999999,"5min":8.4610000000000003,"15min":8.4610000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.117,"15min":1.27},"min":{"1min":0.57299999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.99199999999999999,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.68100000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.79000000000000004,"15min":0.85799999999999998},"min":{"1min":0.46300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91900000000000004,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.71299999999999997,"15min":0.753},"min":{"1min":0.43099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88500000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.85499999999999998,"15min":0.91100000000000003},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95099999999999996,"5min":4.548,"15min":4.548},"last":0.59599999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:30:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.89300000000000002,"15min":0.97499999999999998},"min":{"1min":0.51100000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.89900000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.79600000000000004,"15min":0.82399999999999995},"min":{"1min":0.55900000000000005,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0620000000000001,"5min":1.931,"15min":1.931},"last":0.77500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.98299999999999998,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":9.6859999999999999,"15min":9.6859999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.96499999999999997,"15min":1.079},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94699999999999995,"5min":9.4990000000000006,"15min":9.4990000000000006},"last":0.59899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.024},"min":{"1min":0.53100000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":6.8970000000000002,"15min":6.8970000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.89800000000000002,"15min":0.96799999999999997},"min":{"1min":0.51700000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":1.0089999999999999,"15min":1.1259999999999999},"min":{"1min":0.53000000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98999999999999999,"5min":11.622,"15min":11.622},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.02,"15min":1.1439999999999999},"min":{"1min":0.496,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":10.835000000000001,"15min":10.835000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.98399999999999999,"15min":1.087},"min":{"1min":0.56000000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92500000000000004,"5min":9.6419999999999995,"15min":9.6419999999999995},"last":0.62},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.98899999999999999,"15min":1.0860000000000001},"min":{"1min":0.61599999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96799999999999997,"5min":6.7309999999999999,"15min":6.7309999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.82899999999999996,"15min":0.94499999999999995},"min":{"1min":0.42299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":7.0570000000000004,"15min":7.0570000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.77200000000000002,"15min":0.85699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92700000000000005,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.52400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.86099999999999999,"15min":0.95199999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.95299999999999996,"5min":5.242,"15min":5.242},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.92600000000000005,"15min":1.0249999999999999},"min":{"1min":0.47999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":6.4450000000000003,"15min":6.4450000000000003},"last":0.76200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.746,"15min":0.78600000000000003},"min":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88800000000000001,"5min":1.621,"15min":1.621},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.92800000000000005,"15min":1.028},"min":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":6.0620000000000003,"15min":6.0620000000000003},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.57799999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97199999999999998,"5min":1.306,"15min":1.306},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.73299999999999998,"15min":0.71499999999999997},"min":{"1min":0.65900000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63}]},{"osd":1,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.84099999999999997,"15min":0.86099999999999999},"min":{"1min":0.66800000000000004,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0369999999999999,"5min":3.8130000000000002,"15min":3.8130000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.874},"min":{"1min":0.64100000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.048,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.64700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68799999999999994,"15min":0.69199999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":0.999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.627,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.115,"5min":1.23,"15min":1.23},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68899999999999995,"15min":0.67300000000000004},"min":{"1min":0.59099999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99299999999999999,"5min":1.202,"15min":1.202},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.39900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85499999999999998,"5min":1.171,"15min":1.171},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81699999999999995,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65500000000000003,"15min":0.67100000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84199999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84199999999999997,"5min":1.175,"15min":1.175},"last":0.76900000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:30:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.504,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.80600000000000005,"5min":1.149,"15min":1.149},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.876,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.74299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":1.0109999999999999,"15min":1.258},"min":{"1min":0.317,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69099999999999995,"5min":17.771000000000001,"15min":17.771000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":1.0489999999999999,"15min":1.3029999999999999},"min":{"1min":0.34100000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":18.603999999999999,"15min":18.603999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":1.02,"15min":1.258},"min":{"1min":0.35999999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.69699999999999995,"5min":16.952000000000002,"15min":16.952000000000002},"last":0.433},{"interface":"front","average":{"1min":0.61599999999999999,"5min":1.0740000000000001,"15min":1.2689999999999999},"min":{"1min":0.499,"5min":0.372,"15min":0.372},"max":{"1min":0.77000000000000002,"5min":15.847,"15min":15.847},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":1.135,"15min":1.3879999999999999},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":19.356999999999999,"15min":19.356999999999999},"last":0.503},{"interface":"front","average":{"1min":0.58199999999999996,"5min":1.115,"15min":1.3340000000000001},"min":{"1min":0.44400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83399999999999996,"5min":16.975999999999999,"15min":16.975999999999999},"last":0.57599999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.99099999999999999,"15min":1.1020000000000001},"min":{"1min":0.57799999999999996,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.997,"5min":8.8320000000000007,"15min":8.8320000000000007},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.997,"15min":1.1040000000000001},"min":{"1min":0.57599999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.052,"5min":8.6509999999999998,"15min":8.6509999999999998},"last":0.84299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":1.2370000000000001,"15min":1.4319999999999999},"min":{"1min":0.56699999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.999,"5min":15.153,"15min":15.153},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.0780000000000001,"15min":1.2170000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0660000000000001,"5min":10.874000000000001,"15min":10.874000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.0009999999999999,"15min":1.1040000000000001},"min":{"1min":0.55300000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93000000000000005,"5min":7.9870000000000001,"15min":7.9870000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":1.0740000000000001},"min":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.085,"5min":7.2629999999999999,"15min":7.2629999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.54400000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0289999999999999,"5min":1.99,"15min":1.99},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.625,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1100000000000001,"5min":2.0110000000000001,"15min":2.0110000000000001},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.312,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45300000000000001},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.75,"15min":0.75},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.436,"15min":0.433},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.432},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57099999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.747},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75,"15min":0.75800000000000001},"min":{"1min":0.60599999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0620000000000001,"5min":1.099,"15min":1.099},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76500000000000001,"15min":0.752},"min":{"1min":0.57499999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79800000000000004,"15min":0.80000000000000004},"min":{"1min":0.56200000000000006,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.123,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.59799999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.81599999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.145,"5min":1.198,"15min":1.198},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78800000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0720000000000001,"5min":1.131,"15min":1.131},"last":0.82899999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80300000000000005,"15min":0.78900000000000003},"min":{"1min":0.67700000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.79300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302020,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069820,"statfs":{"total":96636764160,"available":96327495680,"internally_reserved":0,"allocated":512000,"data_stored":212469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.33800000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47099999999999997,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71199999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.86199999999999999,"5min":1.179,"15min":1.179},"last":0.63600000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57899999999999996,"15min":0.56599999999999995},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.57799999999999996,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.875},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":1.006}]},{"osd":5,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.80300000000000005,"15min":0.79600000000000004},"min":{"1min":0.626,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.98599999999999999,"5min":1.286,"15min":1.286},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61299999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0429999999999999,"5min":1.069,"15min":1.069},"last":0.84199999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.81100000000000005},"min":{"1min":0.63600000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0740000000000001,"5min":1.222,"15min":1.222},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59199999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.044,"5min":1.242,"15min":1.242},"last":1.0529999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83199999999999996,"15min":0.82999999999999996},"min":{"1min":0.64800000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.98299999999999998,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.66600000000000004,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.997,"5min":1.246,"15min":1.246},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":802837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.504,"15min":0.504},"min":{"1min":0.37,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63800000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.46700000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.35899999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77600000000000002,"5min":3.0569999999999999,"15min":3.0569999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58899999999999997,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.76100000000000001,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56000000000000005,"15min":0.58699999999999997},"min":{"1min":0.36199999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68400000000000005,"5min":3.9199999999999999,"15min":3.9199999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.47799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82299999999999995,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.82499999999999996,"15min":0.85699999999999998},"min":{"1min":0.56799999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.92800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.82699999999999996,"15min":0.85499999999999998},"min":{"1min":0.58699999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94599999999999995,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":1.109},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80700000000000005,"15min":0.82299999999999995},"min":{"1min":0.59999999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.042,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.133}]},{"osd":6,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0700000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83299999999999996,"15min":0.84899999999999998},"min":{"1min":0.625,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.046,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.81899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:25 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.65300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":2.4119999999999999,"15min":2.4119999999999999},"last":1.008},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.87,"15min":0.91500000000000004},"min":{"1min":0.60299999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90900000000000003,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":1.0269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:16.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:31:17.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.041+0000 7f072d200640 1 Processor -- start 2024-08-17T02:31:17.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.041+0000 7f072d200640 1 -- start start 2024-08-17T02:31:17.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.042+0000 7f072d200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f07280ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.042+0000 7f072d200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f07280ac000 0x7f07280aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.042+0000 7f072d200640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07280a96c0 con 0x7f0728159120 2024-08-17T02:31:17.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.042+0000 7f072d200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07280acf00 con 0x7f07280ac000 2024-08-17T02:31:17.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.042+0000 7f072d200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280af7d0 con 0x7f0728158d50 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.042+0000 7f0726800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f07280ac000 0x7f07280aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0726800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f07280ac000 0x7f07280aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35232/0 (socket says 172.21.15.42:35232) 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0726800640 1 -- 172.21.15.42:0/327010786 learned_addr learned my addr 172.21.15.42:0/327010786 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0725e00640 1 --2- 172.21.15.42:0/327010786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f07280ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0726800640 1 -- 172.21.15.42:0/327010786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 msgr2=0x7f07280ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0726800640 1 --2- 172.21.15.42:0/327010786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f07280ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0726800640 1 -- 172.21.15.42:0/327010786 >> v1:172.21.15.62:6789/0 conn(0x7f0728159120 legacy=0x7f07280ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.043+0000 7f0726800640 1 -- 172.21.15.42:0/327010786 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07280a98f0 con 0x7f07280ac000 2024-08-17T02:31:17.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.044+0000 7f0726800640 1 --2- 172.21.15.42:0/327010786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07280aa3d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0720009f20 tx=0x7f0720009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf6e4a1b65e62c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.044+0000 7f0725400640 1 -- 172.21.15.42:0/327010786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720031400 con 0x7f07280ac000 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.044+0000 7f0725400640 1 -- 172.21.15.42:0/327010786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072002d050 con 0x7f07280ac000 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.044+0000 7f0725400640 1 -- 172.21.15.42:0/327010786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200317d0 con 0x7f07280ac000 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 -- 172.21.15.42:0/327010786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 msgr2=0x7f07280aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 --2- 172.21.15.42:0/327010786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07280aa3d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0720009f20 tx=0x7f0720009840 comp rx=0 tx=0).stop 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 -- 172.21.15.42:0/327010786 shutdown_connections 2024-08-17T02:31:17.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 --2- 172.21.15.42:0/327010786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07280aa3d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 --2- 172.21.15.42:0/327010786 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f07280ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 -- 172.21.15.42:0/327010786 >> 172.21.15.42:0/327010786 conn(0x7f0728095a70 msgr2=0x7f0728095e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 -- 172.21.15.42:0/327010786 shutdown_connections 2024-08-17T02:31:17.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.045+0000 7f072d200640 1 -- 172.21.15.42:0/327010786 wait complete. 2024-08-17T02:31:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.046+0000 7f072d200640 1 Processor -- start 2024-08-17T02:31:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.046+0000 7f072d200640 1 -- start start 2024-08-17T02:31:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f072d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07281457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f072d200640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f0728097600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f072d200640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0728159120 0x7f0728097b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f072d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728099000 con 0x7f07280ac000 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f072d200640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728098110 con 0x7f0728159120 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f072d200640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280983f0 con 0x7f0728158d50 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.047+0000 7f0725e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07281457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07281457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35242/0 (socket says 172.21.15.42:35242) 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 -- 172.21.15.42:0/3256300670 learned_addr learned my addr 172.21.15.42:0/3256300670 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:31:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0726800640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0728159120 0x7f0728097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f071fe00640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f0728097600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 -- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 msgr2=0x7f0728097600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f0728097600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 -- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0728159120 msgr2=0x7f0728097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0728159120 0x7f0728097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 -- 172.21.15.42:0/3256300670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720009ae0 con 0x7f07280ac000 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f0725e00640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07281457c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f071800d890 tx=0x7f0718008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800de20 con 0x7f07280ac000 2024-08-17T02:31:17.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071800b8d0 con 0x7f07280ac000 2024-08-17T02:31:17.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.048+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800bc70 con 0x7f07280ac000 2024-08-17T02:31:17.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.049+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07280986d0 con 0x7f07280ac000 2024-08-17T02:31:17.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.049+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0728098c90 con 0x7f07280ac000 2024-08-17T02:31:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.050+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0728098e20 con 0x7f07280ac000 2024-08-17T02:31:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.050+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0718014640 con 0x7f07280ac000 2024-08-17T02:31:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.051+0000 7f071d600640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0704065150 0x7f0704067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.051+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f07180828a0 con 0x7f07280ac000 2024-08-17T02:31:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.051+0000 7f071fe00640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0704065150 0x7f0704067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.052+0000 7f071fe00640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0704065150 0x7f0704067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f07281561a0 tx=0x7f0710009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.055+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0718050b60 con 0x7f07280ac000 2024-08-17T02:31:17.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.236+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0728063fb0 con 0x7f07280ac000 2024-08-17T02:31:17.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.241+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0718050b60 con 0x7f07280ac000 2024-08-17T02:31:17.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.241+0000 7f071d600640 1 -- 172.21.15.42:0/3256300670 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0718054180 con 0x7f07280ac000 2024-08-17T02:31:17.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.244+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0704065150 msgr2=0x7f0704067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.244+0000 7f072d200640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0704065150 0x7f0704067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f07281561a0 tx=0x7f0710009040 comp rx=0 tx=0).stop 2024-08-17T02:31:17.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.244+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 msgr2=0x7f07281457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.244+0000 7f072d200640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07281457c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f071800d890 tx=0x7f0718008040 comp rx=0 tx=0).stop 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 shutdown_connections 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f0704065150 0x7f0704067600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0728159120 0x7f0728097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0728158d50 0x7f0728097600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 --2- 172.21.15.42:0/3256300670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07280ac000 0x7f07281457c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 >> 172.21.15.42:0/3256300670 conn(0x7f0728095a70 msgr2=0x7f07280ab190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 shutdown_connections 2024-08-17T02:31:17.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.245+0000 7f072d200640 1 -- 172.21.15.42:0/3256300670 wait complete. 2024-08-17T02:31:17.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:31:17.262 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.413+0000 7f53ce800640 1 Processor -- start 2024-08-17T02:31:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.413+0000 7f53ce800640 1 -- start start 2024-08-17T02:31:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.414+0000 7f53ce800640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53c80add30 0x7f53c8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.414+0000 7f53ce800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80cb160 con 0x7f53c80ad960 2024-08-17T02:31:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.414+0000 7f53ce800640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80b0d10 con 0x7f53c80ca050 2024-08-17T02:31:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.414+0000 7f53ce800640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80ca550 con 0x7f53c80add30 2024-08-17T02:31:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.414+0000 7f53c7400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f53c80ad960 0x7f53c8156420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:57088/0 (socket says 172.21.15.42:57088) 2024-08-17T02:31:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c7400640 1 -- 172.21.15.42:0/3592303438 learned_addr learned my addr 172.21.15.42:0/3592303438 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-08-17T02:31:17.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c7e00640 1 --2- 172.21.15.42:0/3592303438 >> v2:172.21.15.62:3300/0 conn(0x7f53c80add30 0x7f53c8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153820859 0 0) 0x7f53c80cb160 con 0x7f53c80ad960 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53ac0034e0 con 0x7f53c80ad960 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222353091 0 0) 0x7f53ac0034e0 con 0x7f53c80ad960 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 >> v2:172.21.15.62:3300/0 conn(0x7f53c80add30 msgr2=0x7f53c8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 --2- 172.21.15.42:0/3592303438 >> v2:172.21.15.62:3300/0 conn(0x7f53c80add30 0x7f53c8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 >> v1:172.21.15.62:6789/0 conn(0x7f53c80ca050 legacy=0x7f53c80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80ca830 con 0x7f53c80ad960 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 744904432 0 0) 0x7f53b8001470 con 0x7f53c80ad960 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 >> v1:172.21.15.42:6789/0 conn(0x7f53c80ad960 legacy=0x7f53c8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0039d0 0x7f53ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac004780 0x7f53ac004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.415+0000 7f53c6000640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53ac005130 0x7f53ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80ca550 con 0x7f53ac0039d0 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac00bfc0 con 0x7f53ac004780 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac00c180 con 0x7f53ac005130 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7400640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0039d0 0x7f53ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c6a00640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac004780 0x7f53ac004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7e00640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53ac005130 0x7f53ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7400640 1 -- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53ac005130 msgr2=0x7f53ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7400640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53ac005130 0x7f53ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7400640 1 -- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac004780 msgr2=0x7f53ac004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7400640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac004780 0x7f53ac004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7400640 1 -- 172.21.15.42:0/3592303438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0034e0 con 0x7f53ac0039d0 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c6a00640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac004780 0x7f53ac004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.416+0000 7f53c7e00640 1 -- 172.21.15.42:0/3592303438 reap_dead start 2024-08-17T02:31:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.417+0000 7f53c7400640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0039d0 0x7f53ac003da0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f53b800c2d0 tx=0x7f53b8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d396a2f93f10a92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8005890 con 0x7f53ac0039d0 2024-08-17T02:31:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f53b802d070 con 0x7f53ac0039d0 2024-08-17T02:31:17.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53c6000640 1 -- 172.21.15.42:0/3592303438 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8005a90 con 0x7f53ac0039d0 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 -- 172.21.15.42:0/3592303438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0039d0 msgr2=0x7f53ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0039d0 0x7f53ac003da0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f53b800c2d0 tx=0x7f53b8001e70 comp rx=0 tx=0).stop 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 -- 172.21.15.42:0/3592303438 shutdown_connections 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 --2- 172.21.15.42:0/3592303438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0039d0 0x7f53ac003da0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 -- 172.21.15.42:0/3592303438 >> 172.21.15.42:0/3592303438 conn(0x7f53c8066e60 msgr2=0x7f53c8067260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 -- 172.21.15.42:0/3592303438 shutdown_connections 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.418+0000 7f53ce800640 1 -- 172.21.15.42:0/3592303438 wait complete. 2024-08-17T02:31:17.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.420+0000 7f53ce800640 1 Processor -- start 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.420+0000 7f53ce800640 1 -- start start 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.420+0000 7f53ce800640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac0039d0 0x7f53c8146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.420+0000 7f53ce800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 0x7f53c80a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.420+0000 7f53ce800640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c80a6140 0x7f53c80a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53ce800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80a6610 con 0x7f53c80a4e10 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53ce800640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c815c520 con 0x7f53ac0039d0 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53ce800640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c815c800 con 0x7f53c80a6140 2024-08-17T02:31:17.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 0x7f53c80a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 0x7f53c80a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35268/0 (socket says 172.21.15.42:35268) 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 -- 172.21.15.42:0/3013087744 learned_addr learned my addr 172.21.15.42:0/3013087744 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c7e00640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c80a6140 0x7f53c80a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c7400640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac0039d0 0x7f53c8146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 -- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c80a6140 msgr2=0x7f53c80a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c80a6140 0x7f53c80a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 -- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac0039d0 msgr2=0x7f53c8146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac0039d0 0x7f53c8146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 -- 172.21.15.42:0/3013087744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c815cae0 con 0x7f53c80a4e10 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.421+0000 7f53c6a00640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 0x7f53c80a5c00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53b400f9d0 tx=0x7f53b4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.422+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4011590 con 0x7f53c80a4e10 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.422+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f53b40116f0 con 0x7f53c80a4e10 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.422+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4011a70 con 0x7f53c80a4e10 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.422+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c815cdc0 con 0x7f53c80a4e10 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.422+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80a98c0 con 0x7f53c80a4e10 2024-08-17T02:31:17.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.423+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c815cfb0 con 0x7f53c80a4e10 2024-08-17T02:31:17.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.424+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f53b401d460 con 0x7f53c80a4e10 2024-08-17T02:31:17.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.425+0000 7f53bea00640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f53a8065150 0x7f53a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.425+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f53b4082130 con 0x7f53c80a4e10 2024-08-17T02:31:17.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.425+0000 7f53c7400640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f53a8065150 0x7f53a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.426+0000 7f53c7400640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f53a8065150 0x7f53a8067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53b8007c20 tx=0x7f53b8001e70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.429+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53b4050470 con 0x7f53c80a4e10 2024-08-17T02:31:17.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.655+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53c8063fb0 con 0x7f53c80a4e10 2024-08-17T02:31:17.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.655+0000 7f53bea00640 1 -- 172.21.15.42:0/3013087744 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f53b4053a90 con 0x7f53c80a4e10 2024-08-17T02:31:17.657 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-08-17T02:31:17.657 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3984666339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6835","nonce":3984666339},{"type":"v1","addr":"172.21.15.42:6837","nonce":3984666339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/392979974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":392979974},{"type":"v1","addr":"172.21.15.62:6834","nonce":392979974}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5247,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6836/2058513191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2058513191},{"type":"v1","addr":"172.21.15.42:6836","nonce":2058513191}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5352,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2540194602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2540194602},{"type":"v1","addr":"172.21.15.62:6835","nonce":2540194602}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-08-17T02:31:17.657 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2024-08-17T02:31:17.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f53a8065150 msgr2=0x7f53a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f53a8065150 0x7f53a8067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53b8007c20 tx=0x7f53b8001e70 comp rx=0 tx=0).stop 2024-08-17T02:31:17.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 msgr2=0x7f53c80a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 0x7f53c80a5c00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53b400f9d0 tx=0x7f53b4009040 comp rx=0 tx=0).stop 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 shutdown_connections 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:6832/36609,v1:172.21.15.42:6833/36609] conn(0x7f53a8065150 0x7f53a8067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c80a6140 0x7f53c80a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53c80a4e10 0x7f53c80a5c00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 --2- 172.21.15.42:0/3013087744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53ac0039d0 0x7f53c8146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 >> 172.21.15.42:0/3013087744 conn(0x7f53c8066e60 msgr2=0x7f53c80ac240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 shutdown_connections 2024-08-17T02:31:17.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-08-17T02:31:17.658+0000 7f53ce800640 1 -- 172.21.15.42:0/3013087744 wait complete. 2024-08-17T02:31:17.675 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:31:17.675 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:31:17.675 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:31:17.675 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:17.690 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:31:17.690 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:31:17.690 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:17.744 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:31:17.744 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:31:17.744 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:17.760 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:31:17.760 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:31:17.761 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:17.816 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:31:17.817 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:31:17.817 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:31:17.817 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:17.858 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:31:17.858 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:31:17.858 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:17.946 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:31:17.947 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:31:17.947 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.006 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:31:18.007 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.051 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:31:18.051 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:31:18.052 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.108 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:31:18.108 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:31:18.109 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.161 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:31:18.161 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:31:18.161 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.213 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:31:18.213 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:31:18.214 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.263 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:31:18.263 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:31:18.263 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:31:18.264 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.325 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:31:18.326 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:31:18.326 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.383 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:31:18.384 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:31:18.384 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:31:18.384 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.404 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:31:18.404 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:31:18.404 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.423 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:31:18.423 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:31:18.423 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:18.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-08-17T02:31:18.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-08-17T02:31:18.483 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:31:18.483 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:31:18.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:31:18.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:31:18.563 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:31:18.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:31:18.822 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:31:18.928 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:31:18.929 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:31:19.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:31:19.028 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:31:19.127 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:31:19.128 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:31:19.331 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:31:19.332 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:31:19.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:31:19.518 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:31:19.627 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:31:19.627 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:31:19.753 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:31:19.754 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/data/mon.a.tgz 2024-08-17T02:31:19.755 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-08-17T02:31:19.791 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.IdxKDcRds6 2024-08-17T02:31:19.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IdxKDcRds6 2024-08-17T02:31:19.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.IdxKDcRds6 2024-08-17T02:31:20.066 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.IdxKDcRds6 is 310KB 2024-08-17T02:31:20.155 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.IdxKDcRds6 2024-08-17T02:31:20.190 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/data/mon.b.tgz 2024-08-17T02:31:20.190 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-08-17T02:31:20.225 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.RPZByBH4DB 2024-08-17T02:31:20.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RPZByBH4DB 2024-08-17T02:31:20.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:20.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:20.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.RPZByBH4DB 2024-08-17T02:31:20.606 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.RPZByBH4DB is 409KB 2024-08-17T02:31:20.694 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.RPZByBH4DB 2024-08-17T02:31:20.728 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/data/mon.c.tgz 2024-08-17T02:31:20.729 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-08-17T02:31:20.803 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.4XmaWmzSQJ 2024-08-17T02:31:20.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4XmaWmzSQJ 2024-08-17T02:31:20.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.4XmaWmzSQJ 2024-08-17T02:31:21.082 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.4XmaWmzSQJ is 409KB 2024-08-17T02:31:21.171 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.4XmaWmzSQJ 2024-08-17T02:31:21.206 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:31:21.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:21.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:21.301 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:31:21.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:21.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:21.365 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:21.368 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:21.379 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:31:21.380 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/remote/smithi042/crash 2024-08-17T02:31:21.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:21.436 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/remote/smithi062/crash 2024-08-17T02:31:21.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:21.491 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:31:21.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:21.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:21.582 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:21.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:21.692 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:31:21.693 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:21.697 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:21.746 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40910.log 2024-08-17T02:31:21.747 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41015.log 2024-08-17T02:31:21.748 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-08-17T02:31:21.748 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40910.log.gz 2024-08-17T02:31:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41015.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41015.log.gz 2024-08-17T02:31:21.749 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49647.log 2024-08-17T02:31:21.750 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47162.log 2024-08-17T02:31:21.751 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-08-17T02:31:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:21.752 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:21.753 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-08-17T02:31:21.754 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43138.log 2024-08-17T02:31:21.754 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49647.log.gz 2024-08-17T02:31:21.755 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47078.log 2024-08-17T02:31:21.755 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47162.log.gz 2024-08-17T02:31:21.755 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2024-08-17T02:31:21.755 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43138.log.gz 2024-08-17T02:31:21.755 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-08-17T02:31:21.755 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47078.log.gz 2024-08-17T02:31:21.764 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:31:21.764 INFO:teuthology.orchestra.run.smithi062.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:21.764 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37028.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:31:21.764 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-08-17T02:31:21.764 INFO:teuthology.orchestra.run.smithi062.stderr: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37209.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42302.log 2024-08-17T02:31:21.765 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:31:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.1.42302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42302.log.gz 2024-08-17T02:31:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:31:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43030.log 2024-08-17T02:31:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:31:21.766 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.1.43030.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-08-17T02:31:21.766 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.1.43030.log.gz 2024-08-17T02:31:21.772 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-08-17T02:31:21.772 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37169.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-08-17T02:31:21.772 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37127.log: /var/log/ceph/ceph-client.3.42641.log 2024-08-17T02:31:21.772 INFO:teuthology.orchestra.run.smithi062.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:31:21.772 INFO:teuthology.orchestra.run.smithi062.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36988.log 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.3.42641.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.37076.log -- replaced with /var/log/ceph/ceph-client.3.42641.log.gz 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.36988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37250.log 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36988.log.gz 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37076.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:31:21.773 INFO:teuthology.orchestra.run.smithi062.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37076.log.gz 2024-08-17T02:31:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37250.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:31:21.777 INFO:teuthology.orchestra.run.smithi062.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37250.log.gz 2024-08-17T02:31:21.777 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37290.log 2024-08-17T02:31:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44799.log 2024-08-17T02:31:21.778 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2024-08-17T02:31:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2024-08-17T02:31:21.778 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-08-17T02:31:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2024-08-17T02:31:21.778 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44799.log.gz 2024-08-17T02:31:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45437.log 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gz 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gz 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45437.log.gz 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45051.log 2024-08-17T02:31:21.779 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44505.log 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45051.log.gz 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50320.log 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44505.log.gz 2024-08-17T02:31:21.780 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50320.log.gz 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50110.log 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46808.log 2024-08-17T02:31:21.781 INFO:teuthology.orchestra.run.smithi042.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50110.log.gz 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43900.log 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.43900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43900.log.gz 2024-08-17T02:31:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49774.log 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49774.log.gz 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-08-17T02:31:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43222.log: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz -- 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.50152.log 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49082.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2024-08-17T02:31:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2024-08-17T02:31:21.785 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50152.log.gz 2024-08-17T02:31:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-08-17T02:31:21.786 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.37290.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37290.log.gz 2024-08-17T02:31:21.791 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49492.log 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47971.log 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49492.log.gz 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42844.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz 2024-08-17T02:31:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45303.log 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42263.log 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47971.log.gz 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46976.log 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45303.log.gz 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42263.log.gz 2024-08-17T02:31:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46976.log.gz 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49900.log 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-08-17T02:31:21.794 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49900.log.gz 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50026.log 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43012.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50026.log.gz 2024-08-17T02:31:21.795 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48998.log 2024-08-17T02:31:21.796 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-08-17T02:31:21.796 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:21.796 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-08-17T02:31:21.797 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:31:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45605.log 2024-08-17T02:31:21.800 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48998.log.gz 2024-08-17T02:31:21.800 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42928.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41073.log 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45605.log.gz 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42268.log 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41073.log.gz 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41500.log 2024-08-17T02:31:21.801 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42268.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42268.log.gz 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49450.log 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41500.log.gz 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46082.log 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-08-17T02:31:21.802 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41923.log 2024-08-17T02:31:21.803 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49450.log.gz 2024-08-17T02:31:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46082.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46082.log.gz 2024-08-17T02:31:21.803 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50444.log 2024-08-17T02:31:21.805 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49816.log 2024-08-17T02:31:21.805 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41923.log.gz 2024-08-17T02:31:21.805 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50444.log.gz 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49816.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49816.log.gz 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49166.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2024-08-17T02:31:21.806 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42604.log 2024-08-17T02:31:21.808 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-08-17T02:31:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45647.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2024-08-17T02:31:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2024-08-17T02:31:21.808 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2024-08-17T02:31:21.808 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42604.log.gz 2024-08-17T02:31:21.810 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2024-08-17T02:31:21.810 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2024-08-17T02:31:21.810 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2024-08-17T02:31:21.810 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2024-08-17T02:31:21.811 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48097.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-08-17T02:31:21.811 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41927.log 2024-08-17T02:31:21.812 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2024-08-17T02:31:21.812 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 2024-08-17T02:31:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41927.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41927.log.gz 2024-08-17T02:31:21.813 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42601.log 2024-08-17T02:31:21.814 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44631.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:31:21.814 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2024-08-17T02:31:21.815 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48830.log 2024-08-17T02:31:21.815 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42601.log.gz 2024-08-17T02:31:21.816 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44547.log 2024-08-17T02:31:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48830.log.gz 2024-08-17T02:31:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49942.log 2024-08-17T02:31:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44547.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44547.log.gz 2024-08-17T02:31:21.818 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50362.log 2024-08-17T02:31:21.819 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-08-17T02:31:21.820 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50362.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49942.log.gz 2024-08-17T02:31:21.821 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50278.log 2024-08-17T02:31:21.821 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50362.log.gz 2024-08-17T02:31:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-08-17T02:31:21.822 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46934.log 2024-08-17T02:31:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50278.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:31:21.823 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46934.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50278.log.gz 2024-08-17T02:31:21.824 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:31:21.824 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46934.log.gz 2024-08-17T02:31:21.825 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46672.log 2024-08-17T02:31:21.827 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41458.log 2024-08-17T02:31:21.828 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50402.log 2024-08-17T02:31:21.828 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46672.log.gz 2024-08-17T02:31:21.830 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-08-17T02:31:21.830 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41458.log.gz 2024-08-17T02:31:21.831 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50402.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50402.log.gz 2024-08-17T02:31:21.832 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43963.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-08-17T02:31:21.832 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-08-17T02:31:21.834 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:31:21.835 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2024-08-17T02:31:21.835 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-08-17T02:31:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.42249.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2024-08-17T02:31:21.838 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-08-17T02:31:21.841 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44307.log 2024-08-17T02:31:21.842 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-08-17T02:31:21.842 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46892.log 2024-08-17T02:31:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44307.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44307.log.gz 2024-08-17T02:31:21.844 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-08-17T02:31:21.846 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46892.log.gz 2024-08-17T02:31:21.846 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2024-08-17T02:31:21.847 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46332.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-08-17T02:31:21.848 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47586.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2024-08-17T02:31:21.849 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36873.log 2024-08-17T02:31:21.850 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-08-17T02:31:21.852 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36873.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36873.log.gz 2024-08-17T02:31:21.853 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43306.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-08-17T02:31:21.854 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48788.log 2024-08-17T02:31:21.855 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2024-08-17T02:31:21.856 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48788.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:31:21.856 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48788.log.gz 2024-08-17T02:31:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45479.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2024-08-17T02:31:21.858 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44263.log 2024-08-17T02:31:21.859 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41931.log 2024-08-17T02:31:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.2.44263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44263.log.gz 2024-08-17T02:31:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47415.log 2024-08-17T02:31:21.862 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2024-08-17T02:31:21.862 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41931.log.gz 2024-08-17T02:31:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.47415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47415.log.gz 2024-08-17T02:31:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45563.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2024-08-17T02:31:21.865 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44925.log 2024-08-17T02:31:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2024-08-17T02:31:21.868 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49984.log 2024-08-17T02:31:21.868 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44925.log.gz 2024-08-17T02:31:21.869 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41184.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2024-08-17T02:31:21.870 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49984.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49984.log.gz 2024-08-17T02:31:21.870 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2024-08-17T02:31:21.872 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2024-08-17T02:31:21.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48475.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-08-17T02:31:21.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48746.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30540.log 2024-08-17T02:31:21.875 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2024-08-17T02:31:21.876 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49040.log 2024-08-17T02:31:21.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.tmp-client.admin.30540.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30540.log.gz 2024-08-17T02:31:21.877 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:31:21.878 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49040.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47036.log 2024-08-17T02:31:21.879 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49040.log.gz 2024-08-17T02:31:21.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.47036.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47036.log.gz 2024-08-17T02:31:21.882 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45009.log 2024-08-17T02:31:21.883 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41626.log 2024-08-17T02:31:21.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45009.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45009.log.gz 2024-08-17T02:31:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41626.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41626.log.gz 2024-08-17T02:31:21.886 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48956.log 2024-08-17T02:31:21.887 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46002.log 2024-08-17T02:31:21.889 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48956.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48956.log.gz 2024-08-17T02:31:21.890 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46002.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46002.log.gz 2024-08-17T02:31:21.891 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2024-08-17T02:31:21.891 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:31:21.892 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2024-08-17T02:31:21.892 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:31:21.893 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45917.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2024-08-17T02:31:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2024-08-17T02:31:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-08-17T02:31:21.895 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2024-08-17T02:31:21.896 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46628.log 2024-08-17T02:31:21.896 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2024-08-17T02:31:21.897 INFO:teuthology.orchestra.run.smithi062.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:31:21.897 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48872.log 2024-08-17T02:31:21.898 INFO:teuthology.orchestra.run.smithi042.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-08-17T02:31:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46628.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46628.log.gz 2024-08-17T02:31:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-08-17T02:31:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48872.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48704.log 2024-08-17T02:31:21.900 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48872.log.gz 2024-08-17T02:31:21.902 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44883.log 2024-08-17T02:31:21.902 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-08-17T02:31:21.903 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48704.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48704.log.gz /var/log/ceph/ceph-client.admin.44349.log 2024-08-17T02:31:21.903 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-08-17T02:31:21.904 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48013.log 2024-08-17T02:31:21.904 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44883.log.gz 2024-08-17T02:31:21.906 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50194.log 2024-08-17T02:31:21.906 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44349.log.gz 2024-08-17T02:31:21.907 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48013.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48013.log.gz 2024-08-17T02:31:21.908 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50194.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50194.log.gz 2024-08-17T02:31:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46584.log 2024-08-17T02:31:21.910 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43570.log 2024-08-17T02:31:21.911 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-08-17T02:31:21.911 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46584.log.gz 2024-08-17T02:31:21.912 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43570.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43570.log.gz 2024-08-17T02:31:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2024-08-17T02:31:21.913 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42266.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-08-17T02:31:21.914 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47758.log 2024-08-17T02:31:21.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49250.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2024-08-17T02:31:21.916 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.41933.log 2024-08-17T02:31:21.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47758.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47758.log.gz 2024-08-17T02:31:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2024-08-17T02:31:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2024-08-17T02:31:21.918 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41933.log.gz 2024-08-17T02:31:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40829.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2024-08-17T02:31:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2024-08-17T02:31:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45219.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2024-08-17T02:31:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41710.log 2024-08-17T02:31:21.923 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48620.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz -5 2024-08-17T02:31:21.923 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2024-08-17T02:31:21.924 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2024-08-17T02:31:21.924 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41710.log.gz 2024-08-17T02:31:21.925 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47502.log 2024-08-17T02:31:21.926 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz 2024-08-17T02:31:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46722.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2024-08-17T02:31:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47502.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47502.log.gz 2024-08-17T02:31:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-08-17T02:31:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44967.log 2024-08-17T02:31:21.931 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:31:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 2024-08-17T02:31:21.932 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-08-17T02:31:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44967.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44967.log.gz 2024-08-17T02:31:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46247.log 2024-08-17T02:31:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47120.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2024-08-17T02:31:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-08-17T02:31:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41934.log 2024-08-17T02:31:21.936 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2024-08-17T02:31:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42605.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-08-17T02:31:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46850.log 2024-08-17T02:31:21.938 INFO:teuthology.orchestra.run.smithi042.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:31:21.939 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41934.log.gz 2024-08-17T02:31:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47674.log 2024-08-17T02:31:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41668.log 2024-08-17T02:31:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46850.log: /var/log/ceph/ceph-client.admin.47674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46850.log.gz 2024-08-17T02:31:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.41135.log 2024-08-17T02:31:21.941 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47674.log.gz 2024-08-17T02:31:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42507.log 2024-08-17T02:31:21.943 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41668.log.gz 2024-08-17T02:31:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41135.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41135.log.gz -- 2024-08-17T02:31:21.944 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.41928.log 2024-08-17T02:31:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-08-17T02:31:21.945 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42507.log.gz 2024-08-17T02:31:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47800.log 2024-08-17T02:31:21.946 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-08-17T02:31:21.947 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47228.log 2024-08-17T02:31:21.947 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-08-17T02:31:21.948 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41542.log 2024-08-17T02:31:21.948 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47800.log.gz 2024-08-17T02:31:21.949 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47716.log 2024-08-17T02:31:21.949 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47228.log.gz 2024-08-17T02:31:21.950 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41542.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41542.log.gz 2024-08-17T02:31:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-08-17T02:31:21.951 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.47716.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-08-17T02:31:21.952 INFO:teuthology.orchestra.run.smithi042.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47716.log.gz 2024-08-17T02:31:21.953 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:31:21.953 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46163.log 2024-08-17T02:31:21.954 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-08-17T02:31:21.954 INFO:teuthology.orchestra.run.smithi062.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:31:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45521.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-08-17T02:31:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-08-17T02:31:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2024-08-17T02:31:21.956 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46163.log.gz 2024-08-17T02:31:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48349.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-08-17T02:31:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2024-08-17T02:31:21.957 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45261.log 2024-08-17T02:31:21.958 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2024-08-17T02:31:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41280.log 2024-08-17T02:31:21.959 INFO:teuthology.orchestra.run.smithi042.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2024-08-17T02:31:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49208.log 2024-08-17T02:31:21.960 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2024-08-17T02:31:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43054.log 2024-08-17T02:31:21.961 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41280.log.gz 2024-08-17T02:31:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49208.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49208.log.gz 2024-08-17T02:31:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-08-17T02:31:21.963 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:31:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2024-08-17T02:31:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43054.log: /var/log/ceph/ceph-client.admin.46290.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43054.log.gz 2024-08-17T02:31:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2024-08-17T02:31:21.965 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-08-17T02:31:21.965 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-08-17T02:31:21.965 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.236s 2024-08-17T02:31:21.965 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m0.967s 2024-08-17T02:31:21.966 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.179s 2024-08-17T02:31:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-08-17T02:31:21.967 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2024-08-17T02:31:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49534.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz /var/log/ceph/ceph-client.admin.45177.log 2024-08-17T02:31:21.968 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-08-17T02:31:21.968 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-08-17T02:31:21.969 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-08-17T02:31:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45177.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45177.log.gz 2024-08-17T02:31:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41414.log 2024-08-17T02:31:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2024-08-17T02:31:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49732.log: /var/log/ceph/ceph-client.admin.41414.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-08-17T02:31:21.971 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 88.2% 2024-08-17T02:31:21.972 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41414.log.gz 2024-08-17T02:31:21.972 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-08-17T02:31:21.973 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2024-08-17T02:31:21.974 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45857.log 2024-08-17T02:31:21.974 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2024-08-17T02:31:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43432.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:31:21.975 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-08-17T02:31:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-08-17T02:31:21.976 INFO:teuthology.orchestra.run.smithi042.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45857.log.gz 2024-08-17T02:31:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44463.log 2024-08-17T02:31:21.979 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36607.log 2024-08-17T02:31:21.979 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-08-17T02:31:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2024-08-17T02:31:21.980 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44463.log.gz 2024-08-17T02:31:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-08-17T02:31:21.982 INFO:teuthology.orchestra.run.smithi042.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.36607.log.gz 2024-08-17T02:31:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46374.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gz 2024-08-17T02:31:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50236.log 2024-08-17T02:31:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49408.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-08-17T02:31:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50236.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50236.log.gz 2024-08-17T02:31:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-08-17T02:31:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-08-17T02:31:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2024-08-17T02:31:21.989 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-08-17T02:31:21.990 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42256.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-08-17T02:31:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44589.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2024-08-17T02:31:21.992 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49690.log 2024-08-17T02:31:21.993 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49124.log 2024-08-17T02:31:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49583.log 2024-08-17T02:31:21.995 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49690.log.gz 2024-08-17T02:31:21.995 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:31:21.996 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2024-08-17T02:31:21.996 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49124.log.gz 2024-08-17T02:31:21.997 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.49583.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49583.log.gz 2024-08-17T02:31:21.997 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41372.log 2024-08-17T02:31:21.998 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44715.log: /var/log/ceph/ceph-client.admin.41752.log 2024-08-17T02:31:21.999 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2%/var/log/ceph/ceph-client.admin.41372.log: -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2024-08-17T02:31:21.999 INFO:teuthology.orchestra.run.smithi042.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41372.log.gz 2024-08-17T02:31:21.999 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-08-17T02:31:22.000 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.41752.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-08-17T02:31:22.001 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2024-08-17T02:31:22.001 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.46205.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-08-17T02:31:22.001 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-08-17T02:31:22.002 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45093.log 2024-08-17T02:31:22.003 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-08-17T02:31:22.003 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48307.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41330.log 2024-08-17T02:31:22.004 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-08-17T02:31:22.004 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40733.log 2024-08-17T02:31:22.005 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45093.log.gz 2024-08-17T02:31:22.006 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2024-08-17T02:31:22.006 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41330.log.gz 2024-08-17T02:31:22.007 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-08-17T02:31:22.007 INFO:teuthology.orchestra.run.smithi042.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40733.log.gz 2024-08-17T02:31:22.008 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48914.log 2024-08-17T02:31:22.009 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2024-08-17T02:31:22.009 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45135.log 2024-08-17T02:31:22.009 INFO:teuthology.orchestra.run.smithi042.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-08-17T02:31:22.010 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.48914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47544.log 2024-08-17T02:31:22.011 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48914.log.gz 2024-08-17T02:31:22.012 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50068.log 2024-08-17T02:31:22.012 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2024-08-17T02:31:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.47544.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47544.log.gz 2024-08-17T02:31:22.014 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.50068.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50068.log.gz 2024-08-17T02:31:22.030 INFO:teuthology.orchestra.run.smithi042.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:31:22.038 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:31:22.064 INFO:teuthology.orchestra.run.smithi042.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:31:22.162 INFO:teuthology.orchestra.run.smithi042.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:31:22.165 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-08-17T02:31:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.440s 2024-08-17T02:31:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m1.209s 2024-08-17T02:31:22.165 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.635s 2024-08-17T02:31:22.167 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:31:22.167 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/remote/smithi042/log 2024-08-17T02:31:22.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:22.506 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/remote/smithi062/log 2024-08-17T02:31:22.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:22.696 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:31:22.720 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:31:22.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:22.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:22.832 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:31:22.844 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:31:22.844 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:22.848 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:22.878 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:31:22.881 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:31:22.885 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:31:22.885 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-08-17T02:31:22.885 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 -50us[ -36us] +/- 60ms 2024-08-17T02:31:22.885 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -61us[ -61us] +/- 63ms 2024-08-17T02:31:22.885 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +204us[ +204us] +/- 62ms 2024-08-17T02:31:22.885 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:31:22.889 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:31:22.889 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-08-17T02:31:22.889 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 -27us[-2915ns] +/- 60ms 2024-08-17T02:31:22.889 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -36us[ -36us] +/- 63ms 2024-08-17T02:31:22.889 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +200us[ +225us] +/- 62ms 2024-08-17T02:31:22.889 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:31:22.890 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:31:22.900 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:31:22.900 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:31:22.908 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:31:23.046 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:31:23.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:31:23.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:23.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:31:23.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:23.281 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:31:23.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:31:23.300 INFO:teuthology.task.internal:Duration was 762.344624 seconds 2024-08-17T02:31:23.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:31:23.309 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:31:23.309 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:23.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:23.396 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:31:23.402 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:31:23.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-08-17T02:31:23.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-08-17T02:31:23.696 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:31:23.696 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-08-17T02:31:23.696 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:23.745 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-08-17T02:31:23.746 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:23.794 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:31:23.795 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:23.799 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:23.859 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:31:23.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:23.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:24.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:31:24.018 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:31:24.018 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:24.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:24.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:31:24.141 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:24.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:24.212 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-08-17T02:31:24.216 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-08-17T02:31:24.245 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:24.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:24.279 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:24.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:24.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:31:24.323 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:31:24.323 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/remote/smithi042 2024-08-17T02:31:24.324 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:24.388 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858271/remote/smithi062 2024-08-17T02:31:24.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:24.452 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:31:24.453 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:24.457 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:24.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:31:24.504 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:31:24.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:31:24.514 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:31:24.514 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:24.533 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:24.564 INFO:teuthology.orchestra.run.smithi042.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:24.568 INFO:teuthology.orchestra.run.smithi062.stdout: 395192 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:24.570 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:31:24.580 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:31:24.605 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 762.3446238040924 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=50ddd309d63e4dddad00a92accf9248b status: fail success: false 2024-08-17T02:31:24.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:31:24.672 INFO:teuthology.run:FAIL